Re: libcephfs create file with layout and replication

2012-11-20 Thread Noah Watkins
On Mon, Nov 19, 2012 at 7:28 PM, Sage Weil s...@inktank.com wrote: We could avoid the whole issue by passing 4 arguments to the function... I pushed a new patch that takes each of the 4 new arguments. wip-client-open-layout Thanks, -Noah -- To unsubscribe from this list: send the line

Re: libcephfs create file with layout and replication

2012-11-19 Thread Gregory Farnum
On Sun, Nov 18, 2012 at 12:05 PM, Noah Watkins jayh...@cs.ucsc.edu wrote: Wanna have a look at a first pass on this patch? wip-client-open-layout Thanks, Noah Just glanced over this, and I'm curious: 1) Why symlink another reference to your file_layout.h? 2) There's already a

Re: libcephfs create file with layout and replication

2012-11-19 Thread Noah Watkins
On Mon, Nov 19, 2012 at 5:04 PM, Gregory Farnum g...@inktank.com wrote: Just glanced over this, and I'm curious: 1) Why symlink another reference to your file_layout.h? I followed the same pattern as page.h in librados, but may have misunderstood its use. When libcephfs.h is installed, it

Re: libcephfs create file with layout and replication

2012-11-19 Thread Sage Weil
On Mon, 19 Nov 2012, Noah Watkins wrote: On Mon, Nov 19, 2012 at 5:04 PM, Gregory Farnum g...@inktank.com wrote: Just glanced over this, and I'm curious: 1) Why symlink another reference to your file_layout.h? I followed the same pattern as page.h in librados, but may have misunderstood

Re: libcephfs create file with layout and replication

2012-11-18 Thread Noah Watkins
Wanna have a look at a first pass on this patch? wip-client-open-layout Thanks, Noah On Sat, Nov 17, 2012 at 5:20 PM, Noah Watkins jayh...@cs.ucsc.edu wrote: On Sat, Nov 17, 2012 at 4:15 PM, Sage Weil s...@inktank.com wrote: We ignore that for the purposes of getting the libcephfs API

libcephfs create file with layout and replication

2012-11-17 Thread Noah Watkins
The Hadoop VFS layer assumes that block size and replication can be set on a per-file basis, which is important to users for file layout/workload optimizations. The libcephfs interface doesn't make this entirely easy. Here is one approach, but it isn't thread safe as the default values are global

Re: libcephfs create file with layout and replication

2012-11-17 Thread Josh Durgin
On 11/17/2012 12:13 PM, Noah Watkins wrote: The Hadoop VFS layer assumes that block size and replication can be set on a per-file basis, which is important to users for file layout/workload optimizations. The libcephfs interface doesn't make this entirely easy. Here is one approach, but it

Re: libcephfs create file with layout and replication

2012-11-17 Thread Sage Weil
On Sat, 17 Nov 2012, Noah Watkins wrote: The Hadoop VFS layer assumes that block size and replication can be set on a per-file basis, which is important to users for file layout/workload optimizations. The libcephfs interface doesn't make this entirely easy. Here is one approach, but it

Re: libcephfs create file with layout and replication

2012-11-17 Thread Sage Weil
On Sat, 17 Nov 2012, Noah Watkins wrote: On Sat, Nov 17, 2012 at 3:23 PM, Sage Weil s...@inktank.com wrote: On Sat, 17 Nov 2012, Noah Watkins wrote: FWIW, the striping parameters are object size, stripe unit, stripe count, and data pool. In ceph_mds_request_args.open I see the all the

Re: libcephfs create file with layout and replication

2012-11-17 Thread Noah Watkins
On Sat, Nov 17, 2012 at 4:15 PM, Sage Weil s...@inktank.com wrote: We ignore that for the purposes of getting the libcephfs API correct, though... Ok, make sense. Thanks. Noah -- To unsubscribe from this list: send the line unsubscribe ceph-devel in the body of a message to