[ceph-users] Re: How to make CephFS a tiered file system?

2021-07-20 Thread Eugen Block
Hi, I'm not sure if that's what you need but ceph file layouts [1] could meet your requirements. Your CephFS can consist of multiple pools (replicated or EC), and with xattr you can define different pools to be used for specific directories. Does that help? Regards, Eugen [1] https://doc

[ceph-users] Re: How to make CephFS a tiered file system?

2021-07-20 Thread Martin Verges
Hello Samuel, you can use the docs from https://docs.ceph.com/en/latest/cephfs/file-layouts/ to find out how to put a file on a different pool. Example: "setfattr -n ceph.dir.layout.pool -v poolname foldername" Ceph itself does unfortunately not provide tiering out of the box. You therefore have

[ceph-users] Re: How to make CephFS a tiered file system?

2021-07-20 Thread Brady Deetz
What you are proposing is called a hierarchical storage manager (HSM). Cephfs does not have a built in HSM. Would be amazing if it did though. On Mon, Jul 19, 2021, 4:28 PM huxia...@horebdata.cn wrote: > Dear Cepher, > > I have a requirement to use CephFS as a tiered file system, i.e. the data >

[ceph-users] Re: How to make CephFS a tiered file system?

2021-07-20 Thread Calhoun, Patrick
s] Re: How to make CephFS a tiered file system? What you are proposing is called a hierarchical storage manager (HSM). Cephfs does not have a built in HSM. Would be amazing if it did though. On Mon, Jul 19, 2021, 4:28 PM huxia...@horebdata.cn wrote: > Dear Cepher, > > I have a requirement

[ceph-users] Re: How to make CephFS a tiered file system?

2021-07-20 Thread Nathan Fish
You are welcome! Just realized I didn't CC the list properly. On Tue, Jul 20, 2021 at 12:18 PM huxia...@horebdata.cn wrote: > > Hi, Nathan, > > thanks a lot for the suggestions. Indeed it looks quite feasible with > re-layout > > best regards, > > samuel > > > hu

[ceph-users] Re: How to make CephFS a tiered file system?

2021-07-20 Thread Manuel Holtgrewe
Hi, could you elaborate what you mean with "re-layout"? Thanks, Manuel On Tue, Jul 20, 2021 at 10:36 PM Nathan Fish wrote: > You are welcome! Just realized I didn't CC the list properly. > > On Tue, Jul 20, 2021 at 12:18 PM huxia...@horebdata.cn > wrote: > > > > Hi, Nathan, > > > > thanks a l

[ceph-users] Re: How to make CephFS a tiered file system?

2021-07-21 Thread Patrick Donnelly
Hello samuel, On Mon, Jul 19, 2021 at 2:28 PM huxia...@horebdata.cn wrote: > > Dear Cepher, > > I have a requirement to use CephFS as a tiered file system, i.e. the data > will be first stored onto an all-flash pool (using SSD OSDs), and then > automatically moved to an EC coded pool (using HDD

[ceph-users] Re: How to make CephFS a tiered file system?

2021-07-21 Thread huxia...@horebdata.cn
Dear Patrick, Thanks a lot for pointing out the HSM ticket. We will see whether we have the resource to do something with the ticket. I am thinking of a temporary solution for HSM using cephfs client commands. The following command 'setfattr -n ceph.dir.layout.pool -v NewPool Fold

[ceph-users] Re: How to make CephFS a tiered file system?

2021-07-22 Thread Patrick Donnelly
On Wed, Jul 21, 2021 at 1:49 PM huxia...@horebdata.cn wrote: > > Dear Patrick, > > Thanks a lot for pointing out the HSM ticket. We will see whether we have the > resource to do something with the ticket. > > I am thinking of a temporary solution for HSM using cephfs client commands. > The follo

[ceph-users] Re: How to make CephFS a tiered file system?

2021-07-22 Thread Calhoun, Patrick
-Patrick From: Patrick Donnelly Sent: Thursday, July 22, 2021 5:03 PM To: huxia...@horebdata.cn Cc: ceph-users Subject: [ceph-users] Re: How to make CephFS a tiered file system? On Wed, Jul 21, 2021 at 1:49 PM huxia...@horebdata.cn wrote: > > Dear Patrick, > > Thanks a lot for

[ceph-users] Re: How to make CephFS a tiered file system?

2021-07-22 Thread Patrick Donnelly
file_name && mv -f .hidden_file_name > original_file_name > > -Patrick > > From: Patrick Donnelly > Sent: Thursday, July 22, 2021 5:03 PM > To: huxia...@horebdata.cn > Cc: ceph-users > Subject: [ceph-users] Re: How to make CephFS a ti