[ceph-users] Query about contribution regarding monitoring of Ceph Object Storage
Hello all I am carrying out research in the area of cloud computing under Department of CS, University of Delhi. I would like to contribute my research work regarding monitoring of Ceph Object Storage to the Ceph community. Please help me by providing the appropriate link with whom I can connect to know if my work is relevant for contribution. Thank you-RegardsPragya JainDepartment of Computer ScienceUniversity of DelhiDelhi, India___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
Re: [ceph-users] metadata management in case of ceph object storage and ceph block storage
Thanks to all for your reply It is clear that Monitor keeps track of Pools and PGs in the cluster and there is no need of MDS for Ceph object storage and block storage, since both of these storage types do not require to maintain a file hierarchy.But, I have a question:In Ceph Object Storage, If we use Swift APIs to store objects, then objects are stored in some container within an account according to user interface. but in backend, objects are stored in PGs within a pool.Then, from user perspective, there is a need to maintain the information about number of objects stored in a container and number of container in an account etc. and this information is needed to be updated timely as there are any changes in the count. How does Ceph maintain all these information? Please reply. -RegardsPragya JainDepartment of Computer ScienceUniversity of DelhiDelhi, India On Saturday, 18 April 2015 9:16 AM, pragya jain prag_2...@yahoo.co.in wrote: Thanks to all for your reply -RegardsPragya JainDepartment of Computer ScienceUniversity of DelhiDelhi, India On Friday, 17 April 2015 4:36 PM, Steffen W Sørensen ste...@me.com wrote: On 17/04/2015, at 07.33, Josef Johansson jose...@gmail.com wrote: To your question, which I’m not sure I understand completely. So yes, you don’t need the MDS if you just keep track of block storage and object storage. (i.e. images for KVM) So the Mon keeps track of the metadata for the Pool and PG Well there really ain’t no metadata at all as with a traditional File System, monitors keep track of status of OSDs. Client compute which OSDs to go talk to to get to wanted objects. thus no need for central meta data service to tell clients where data are stored. Ceph is a distributed object storage system with potential no SPF and ability to scale out.Try studying Ross’ slides f.ex. here:http://www.slideshare.net/buildacloud/ceph-intro-and-architectural-overview-by-ross-turkor many other good intros on the net, youtube etc. Clients of a Ceph Cluster can access ‘objects’ (blobs with data) through several means, programatic with librados, as virtual block devices through librbd+librados, and finally as a S3 service through rados GW over http[s] the meta data (users + ACLs, buckets+data…) for S3 objects are stored in various pools in Ceph. CephFS built on top of a Ceph object store can best be compared with combination of a POSIX File System and other Networked File Systems f.ex. NFS,CiFS, AFP, only with a different protocol + access mean (FUSE daemon or kernel module). As it implements a regular file name space, it needs to store meta data of which files exist in such a name space, this is the job of the MDS server(s) which of course uses Ceph object store pools to persistent store this file system meta data info and the MDS keep track of all the files, hence the MDS should have at least 10x the memory of what the Mon have. Hmm 10x memory isn’t a rule of thumb in my book, it all depends of use case at hand.MDS tracks meta data of files stored in a CephFS, which usually is far from all data of a cluster unless CephFS is the only usage of course :)Many use Ceph for sharing virtual block devices among multiple Hypervisors as disk devices for virtual machines (VM images), f.ex. with Openstack, Proxmox etc. I’m no Ceph expert, especially not on CephFS, but this is my picture of it :) Maybe the architecture docs could help you out? http://docs.ceph.com/docs/master/architecture/#cluster-map Hope that resolves your question. Cheers,Josef On 06 Apr 2015, at 18:51, pragya jain prag_2...@yahoo.co.in wrote: Please somebody reply my queries. Thank yuo -RegardsPragya JainDepartment of Computer ScienceUniversity of DelhiDelhi, India On Saturday, 4 April 2015 3:24 PM, pragya jain prag_2...@yahoo.co.in wrote: hello all! As the documentation said One of the unique features of Ceph is that it decouples data and metadata.for applying the mechanism of decoupling, Ceph uses Metadata Server (MDS) cluster.MDS cluster manages metadata operations, like open or rename a file On the other hand, Ceph implementation for object storage as a service and block storage as a service does not require MDS implementation. My question is:In case of object storage and block storage, how does Ceph manage the metadata? Please help me to understand this concept more clearly. Thank you -RegardsPragya JainDepartment of Computer ScienceUniversity of DelhiDelhi, India ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users
Re: [ceph-users] metadata management in case of ceph object storage and ceph block storage
Thanks to all for your reply -RegardsPragya JainDepartment of Computer ScienceUniversity of DelhiDelhi, India On Friday, 17 April 2015 4:36 PM, Steffen W Sørensen ste...@me.com wrote: On 17/04/2015, at 07.33, Josef Johansson jose...@gmail.com wrote: To your question, which I’m not sure I understand completely. So yes, you don’t need the MDS if you just keep track of block storage and object storage. (i.e. images for KVM) So the Mon keeps track of the metadata for the Pool and PG Well there really ain’t no metadata at all as with a traditional File System, monitors keep track of status of OSDs. Client compute which OSDs to go talk to to get to wanted objects. thus no need for central meta data service to tell clients where data are stored. Ceph is a distributed object storage system with potential no SPF and ability to scale out.Try studying Ross’ slides f.ex. here:http://www.slideshare.net/buildacloud/ceph-intro-and-architectural-overview-by-ross-turkor many other good intros on the net, youtube etc. Clients of a Ceph Cluster can access ‘objects’ (blobs with data) through several means, programatic with librados, as virtual block devices through librbd+librados, and finally as a S3 service through rados GW over http[s] the meta data (users + ACLs, buckets+data…) for S3 objects are stored in various pools in Ceph. CephFS built on top of a Ceph object store can best be compared with combination of a POSIX File System and other Networked File Systems f.ex. NFS,CiFS, AFP, only with a different protocol + access mean (FUSE daemon or kernel module). As it implements a regular file name space, it needs to store meta data of which files exist in such a name space, this is the job of the MDS server(s) which of course uses Ceph object store pools to persistent store this file system meta data info and the MDS keep track of all the files, hence the MDS should have at least 10x the memory of what the Mon have. Hmm 10x memory isn’t a rule of thumb in my book, it all depends of use case at hand.MDS tracks meta data of files stored in a CephFS, which usually is far from all data of a cluster unless CephFS is the only usage of course :)Many use Ceph for sharing virtual block devices among multiple Hypervisors as disk devices for virtual machines (VM images), f.ex. with Openstack, Proxmox etc. I’m no Ceph expert, especially not on CephFS, but this is my picture of it :) Maybe the architecture docs could help you out? http://docs.ceph.com/docs/master/architecture/#cluster-map Hope that resolves your question. Cheers,Josef On 06 Apr 2015, at 18:51, pragya jain prag_2...@yahoo.co.in wrote: Please somebody reply my queries. Thank yuo -RegardsPragya JainDepartment of Computer ScienceUniversity of DelhiDelhi, India On Saturday, 4 April 2015 3:24 PM, pragya jain prag_2...@yahoo.co.in wrote: hello all! As the documentation said One of the unique features of Ceph is that it decouples data and metadata.for applying the mechanism of decoupling, Ceph uses Metadata Server (MDS) cluster.MDS cluster manages metadata operations, like open or rename a file On the other hand, Ceph implementation for object storage as a service and block storage as a service does not require MDS implementation. My question is:In case of object storage and block storage, how does Ceph manage the metadata? Please help me to understand this concept more clearly. Thank you -RegardsPragya JainDepartment of Computer ScienceUniversity of DelhiDelhi, India ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
Re: [ceph-users] metadata management in case of ceph object storage and ceph block storage
Please somebody reply my queries. Thank yuo -RegardsPragya JainDepartment of Computer ScienceUniversity of DelhiDelhi, India On Saturday, 4 April 2015 3:24 PM, pragya jain prag_2...@yahoo.co.in wrote: hello all! As the documentation said One of the unique features of Ceph is that it decouples data and metadata.for applying the mechanism of decoupling, Ceph uses Metadata Server (MDS) cluster.MDS cluster manages metadata operations, like open or rename a file On the other hand, Ceph implementation for object storage as a service and block storage as a service does not require MDS implementation. My question is:In case of object storage and block storage, how does Ceph manage the metadata? Please help me to understand this concept more clearly. Thank you -RegardsPragya JainDepartment of Computer ScienceUniversity of DelhiDelhi, India ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
[ceph-users] metadata management in case of ceph object storage and ceph block storage
hello all! As the documentation said One of the unique features of Ceph is that it decouples data and metadata.for applying the mechanism of decoupling, Ceph uses Metadata Server (MDS) cluster.MDS cluster manages metadata operations, like open or rename a file On the other hand, Ceph implementation for object storage as a service and block storage as a service does not require MDS implementation. My question is:In case of object storage and block storage, how does Ceph manage the metadata? Please help me to understand this concept more clearly. Thank you -RegardsPragya JainDepartment of Computer ScienceUniversity of DelhiDelhi, India___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
[ceph-users] Fw: query about mapping of Swift/S3 APIs to Ceph cluster APIs
please somebody answer my queries. -RegardsPragya JainDepartment of Computer ScienceUniversity of DelhiDelhi, India On Saturday, 14 March 2015 3:34 PM, pragya jain prag_2...@yahoo.co.in wrote: Hello all! I am working on Ceph object storage architecture from last few months. I am unable to search a document which can describe how Ceph object storage APIs (Swift/S3 APIs) are mappedd with Ceph storage cluster APIs (librados APIs) to store the data at Ceph storage cluster. As the documents say: Radosgw, a gateway interface for ceph object storage users, accept user request to store or retrieve data in the form of Swift APIs or S3 APIs and convert the user's request in RADOS request. Please help me in knowing1. how does Radosgw convert user request to RADOS request ?2. how are HTTP requests mapped with RADOS request? Thank you -RegardsPragya JainDepartment of Computer ScienceUniversity of DelhiDelhi, India ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
[ceph-users] query about region and zone creation while configuring RADOSGW
hello all! I am working on Ceph object storage architecture.I have some queries: In case of configuring federated system, we need to create regions containing one or more zones and the cluster must have a master region and each region must have a master zone. but in case of simple gateway configuration, is there a need to create at least a region and a zone to store the data? Please somebody reply my query. Thank you -RegardsPragya JainDepartment of Computer ScienceUniversity of DelhiDelhi, India___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
[ceph-users] query about mapping of Swift/S3 APIs to Ceph cluster APIs
Hello all! I am working on Ceph object storage architecture from last few months. I am unable to search a document which can describe how Ceph object storage APIs (Swift/S3 APIs) are mappedd with Ceph storage cluster APIs (librados APIs) to store the data at Ceph storage cluster. As the documents say: Radosgw, a gateway interface for ceph object storage users, accept user request to store or retrieve data in the form of Swift APIs or S3 APIs and convert the user's request in RADOS request. Please help me in knowing1. how does Radosgw convert user request to RADOS request ?2. how are HTTP requests mapped with RADOS request? Thank you -RegardsPragya JainDepartment of Computer ScienceUniversity of DelhiDelhi, India___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
Re: [ceph-users] system metrics monitoring
hello sir! I need some open source monitoring tool for examining these metrics. Please suggest some open source monitoring software. Thanks Regards Pragya Jain On Thursday, 11 December 2014 9:16 PM, Denish Patel den...@omniti.com wrote: Try http://www.circonus.com On Thu, Dec 11, 2014 at 1:22 AM, pragya jain prag_2...@yahoo.co.in wrote: please somebody reply my query. RegardsPragya Jain On Tuesday, 9 December 2014 11:53 AM, pragya jain prag_2...@yahoo.co.in wrote: hello all! As mentioned at statistics and monitoring page of Riak Systems Metrics To Graph | Metric | | Available Disk Space | | IOWait | | Read Operations | | Write Operations | | Network Throughput | | Load Average | Can somebody suggest me some monitoring tools that monitor these metrics? Regards Pragya Jain ___ riak-users mailing list riak-us...@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com -- Denish Patel, OmniTI Computer Consulting Inc. Database Architect, http://omniti.com/does/data-management http://www.pateldenish.com ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
Re: [ceph-users] system metrics monitoring
hello sir! According to TomiTakussaari/riak_zabbixCurrently supported Zabbix keys:riak.ring_num_partitions riak.memory_total riak.memory_processes_used riak.pbc_active riak.pbc_connects riak.node_gets riak.node_puts riak.node_get_fsm_time_median riak.node_put_fsm_time_medianAll these metrics are monitored by collectd, OpenTSDB and Ganglia also.I need some monitoring tool that monitor metrics,like, | Available Disk Space | | IOWait | | Read Operations | | Write Operations | | Network Throughput | | Load Average | Does Zabbix provide monitoring of these metrics? Thanks RegardsPragya jain On Friday, 12 December 2014 11:05 AM, Irek Fasikhov malm...@gmail.com wrote: Hi. We use Zabbix. 2014-12-12 8:33 GMT+03:00 pragya jain prag_2...@yahoo.co.in: hello sir! I need some open source monitoring tool for examining these metrics. Please suggest some open source monitoring software. Thanks Regards Pragya Jain On Thursday, 11 December 2014 9:16 PM, Denish Patel den...@omniti.com wrote: Try http://www.circonus.com On Thu, Dec 11, 2014 at 1:22 AM, pragya jain prag_2...@yahoo.co.in wrote: please somebody reply my query. RegardsPragya Jain On Tuesday, 9 December 2014 11:53 AM, pragya jain prag_2...@yahoo.co.in wrote: hello all! As mentioned at statistics and monitoring page of Riak Systems Metrics To Graph | Metric | | Available Disk Space | | IOWait | | Read Operations | | Write Operations | | Network Throughput | | Load Average | Can somebody suggest me some monitoring tools that monitor these metrics? Regards Pragya Jain ___ riak-users mailing list riak-us...@lists.basho.com http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com -- Denish Patel, OmniTI Computer Consulting Inc. Database Architect, http://omniti.com/does/data-management http://www.pateldenish.com ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com -- С уважением, Фасихов Ирек НургаязовичМоб.: +79229045757 ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
Re: [ceph-users] monitoring tool for monitoring end-user
thanks zhu for your reply. Regards Pragya Jain On Thursday, 16 October 2014 7:08 AM, zhu qiang zhu_qiang...@foxmail.com wrote: Maybe you can try “ceph df detail” and sum the pool’s usage for your end-user GLOBAL: SIZE AVAIL RAW USED %RAW USED OBJECTS 3726G 3570G 3799M0.10 419 POOLS: NAME ID CATEGORY USED %USED OBJECTS DIRTY READ WRITE data 0 -0 0 0 0 0 0 metadata 1 -0 0 0 0 0 0 rbd2 -0 0 0 0 0 0 .rgw.root 3 -822 0 3 3 180 3 .rgw.control 4 -0 0 8 8 0 0 .rgw 5 -9834 0 56 56509 208 .rgw.gc6 -0 0 32 3230387 20692 .users.uid 7 -5288 0 20 204187 337 .users 8 -392 0 13 135419 .rgw.buckets.index 9 -0 0 23 2316390 1300 .log 10 -4458k 0 99 990 18024 .rgw.buckets 11 -319M 0 157 157 16074 5836 .usage 12 -0 0 8 8 3091 2834 .users.email 13 -0 0 0 0 0 0 14 -0 0 0 0 3 27 and .rgw.* is rgw client used From:ceph-users [mailto:ceph-users-boun...@lists.ceph.com] On Behalf Of pragya jain Sent: Tuesday, September 09, 2014 3:34 PM To: ceph-users@lists.ceph.com Subject: Re: [ceph-users] monitoring tool for monitoring end-user please somebody reply to clarify it to me. Regards Pragya Jain On Wednesday, 3 September 2014 12:14 PM, pragya jain prag_2...@yahoo.co.in wrote: hi all! Is there any monitoring tool for ceph which monitor end-user level usage and data transfer for ceph object storage service? Please help me to know any type of information related to it. Regards Pragya Jain ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
[ceph-users] purpose of different default pools created by radosgw instance
Hi all! As document says, ceph has some default pools for radosgw instance. These pools are: * .rgw.root * .rgw.control * .rgw.gc * .rgw.buckets * .rgw.buckets.index * .log * .intent-log * .usage * .users * .users.email * .users.swift * .users.uid Can somebody explain me what are the purpose of these different pools in terms of storing the data, for example, according to my understanding, * .users pool contains the information of the users that have their account in the system * .users.swift contains the information of users that are using Swift APIs to authenticate to the system. Please help me to clarify all these concepts. Regards Pragya Jain___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
[ceph-users] different storage disks as a single storage
hi all! I have a very low level query. Please help to clarify it. To store data on a storage cluster, at the bottom, there is a heterogeneous set of storage disks,in which there can be a variety of storage disks, such as SSDs, HDDs, flash drives, tapes and any other type also. Document says that provider view this heterogeneous set of storage disks as a single pool. My question is: #1. how does the provider come to this abstraction layer to view different storage disks as a single storage? #2. Is it a part of storage virtualization? #3. are there any set of APIs to interact with this heterogeneous set of storage disks? Please somebody reply. Regards Pragya Jain ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
[ceph-users] monitoring tool for ceph which monitor end-user level usage
hi all! Is there any monitoring tool for ceph which monitor end-user level usage and data transfer for ceph object storage service? Please help me to know any type of information related to it. Please reply. Regards Pragya Jain___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
[ceph-users] upload data using swift API
hi all! from swift perspective, to upload data in Swift, following steps are performed: * user must have an account in Swift cluster. * user create a container within the account to store his data *user store his data as an object in the container within the account * object information is updated in container database and container information is updated in account database from ceph documentation, I am unable to understand this flow. #1. how the information of object and container is updated in container and account databases respectively? #2. where are all account and container information stored? if there are different pools to store the information, if so, then how the information is updated from object to container and container to account? Please elaborate on these concepts so that I can be more clear about it. Please reply Regards Pragya jain___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
[ceph-users] heterogeneous set of storage disks as a single storage
hi all! I have a very low level query. Please help to clarify it. To store data on a storage cluster, at the bottom, there is a heterogeneous set of storage disks,in which there can be a variety of storage disks, such as SSDs, HDDs, flash drives, tapes and any other type also. Document says that provider view this heterogeneous set of storage disks as a single pool. My question is: #1. how does the provider come to this abstraction layer to view different storage disks as a single storage? #2. Is it a part of storage virtualization? #2. are there any set of APIs to interact with this heterogeneous set of storage disks? Regards Pragya Jain___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
Re: [ceph-users] monitoring tool for monitoring end-user
please somebody reply to clarify it to me. Regards Pragya Jain On Wednesday, 3 September 2014 12:14 PM, pragya jain prag_2...@yahoo.co.in wrote: hi all! Is there any monitoring tool for ceph which monitor end-user level usage and data transfer for ceph object storage service? Please help me to know any type of information related to it. Regards Pragya Jain ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
Re: [ceph-users] question about monitor and paxos relationship
Thanks Greg, Joao and David, The concept why odd no. of monitors are preferred is clear to me, but still I am not clear about the working of Paxos algorithm: #1. All changes in any data structure of monitor whether it is monitor map, OSD map, PG map, MDS map or CRUSH map; are made through Paxos algorithm and #2. Paxos algorithm also establish a quorum among the monitors for recent copy of cluster map. I am unable to understand how these two things are related and connected ? how does Paxos provide these two functionalities? Please help to clarify these points. Regards Pragya Jain On Saturday, 30 August 2014 7:29 AM, Joao Eduardo Luis joao.l...@inktank.com wrote: On 08/29/2014 11:22 PM, J David wrote: So an even number N of monitors doesn't give you any better fault resilience than N-1 monitors. And the more monitors you have, the more traffic there is between them. So when N is even, N monitors consume more resources and provide no extra benefit compared to N-1 monitors. Except for more copies ;) But yeah, if you're going with 2 or 4, you'll be better off with 3 or 5. As long as you don't go with 1 you should be okay. Only go with 1 if you're truly okay with losing whatever you're storing if that one monitor's disk is fried. -Joao -- Joao Eduardo Luis Software Engineer | http://inktank.com | http://ceph.com ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
[ceph-users] question about monitor and paxos relationship
I have some basic question about monitor and paxos relationship: As the documents says, Ceph monitor contains cluster map, if there is any change in the state of the cluster, the change is updated in the cluster map. monitor use paxos algorithm to create the consensus among monitors to establish a quorum. And when we talk about the Paxos algorithm, documents says that monitor writes all changes to the Paxos instance and Paxos writes the changes to a key/value store for strong consistency. #1: I am unable to understand what actually the Paxos algorithm do? all changes in the cluster map are made by Paxos algorithm? how it create a consensus among monitors My assumption is: cluster map is updated when OSD report monitor about any changes, there is no role of Paxos in it. Paxos write changes made only for the monitors. Please somebody elaborate at this point. #2: why odd no. of monitors are recommended for production cluster, not even no.? Please help me to clarify these points. Regards Pragya Jain___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
Re: [ceph-users] Fw: single node installation
hi abhishek and lorieri! the link you have mentioned has two node installation: one is admin-node and another is server-node. for this installation, as i understand, i need two Ubuntu VMs - one for each node. Am i right? Regards Pragya Jain On Monday, 11 August 2014 10:39 AM, Abhishek L abhishek.lekshma...@gmail.com wrote: Lorieri writes: http://ceph.com/docs/dumpling/start/quick-ceph-deploy/ These steps work against the current ceph release (firefly) as well, for me, as far as the config file has the setting osd crush chooseleaf type = 0 -- Abhishek L pgp: 69CF 4838 8EE3 746C 5ED4 1F16 F9F0 641F 1B65 ED5F ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
[ceph-users] Fw: single node installation
please somebody reply my question. On Saturday, 9 August 2014 3:42 PM, pragya jain prag_2...@yahoo.co.in wrote: Hi all, My question is: Can I install ceph for object storage on a single Ubuntu 14.04 VM for testing purpose? if yes, then how? Regards Pragya Jain ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
[ceph-users] Fw: external monitoring tools for processes
please somebody reply my question. On Saturday, 9 August 2014 3:34 PM, pragya jain prag_2...@yahoo.co.in wrote: hi all, can somebody suggest me some external monitoring tools which can monitor whether the processes in ceph, such as, heartbeating, data scrubbing, authentication, backfilling, recovering etc. are working properly or not. Regards Pragya Jain ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
[ceph-users] external monitoring tools for processes
hi all, can somebody suggest me some external monitoring tools which can monitor whether the processes in ceph, such as, heartbeating, data scrubbing, authentication, backfilling, recovering etc. are working properly or not. Regards Pragya Jain___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
Re: [ceph-users] radosgw monitoring
Thanks zhu qiang for your response that means there are only the logs with the help of which we can monitor radosgw instances for coming user request traffic for uploading and downloading the stored data and also for monitoring other features of radosgw no external monitoring tool, such as calamari, nagios collectd, zabbix etc., provide the functionality to monitor radosgw instances. Am I right? Thanks again Pragya Jain On Friday, 25 July 2014 8:12 PM, zhu qiang zhu_qiang...@foxmail.com wrote: Hi, May be you can try the ways below: 1. Set “debug rgw = 2” ,then view the radosgw daemon’s log, also can use ‘sed,grep,awk’,get the infos you want. 2. timely rum “ceph daemon client.radosgw.X perf dump” command to get the statics message of radosgw daemon. This is all I know, may this will be usefull for you. From:ceph-users [mailto:ceph-users-boun...@lists.ceph.com] On Behalf Of pragya jain Sent: Friday, July 25, 2014 6:39 PM To: ceph-users@lists.ceph.com Subject: [ceph-users] radosgw monitoring Hi all, Please suggest me some open source monitoring tools which can monitor radosgw instances for coming user request traffic for uploading and downloading the stored data and also for monitoring other features of radosgw Regards Pragya Jain ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
[ceph-users] ceph features monitored by nagios
Hi all, I am studying nagios for monitoring ceph features. different plugins of nagios monitor ceph cluster health, o0sd status, monitor status etc. My questions are: * Does Nagios monitor ceph for cluster, pool and each PG for - CPU utilization - memory utilization - Network Utilization - total storage capacity, storage capacity used, storage capacity remaining etc. * Does Nagios monitor ceph for drive configuration, Bad sectors/ fragmented disk, Co-resident monitors/OSDs, Co-resident processes, Kernel version, Mounted filesystem for each OSD? Please help me to find out the answers of my questions Regards Pragya Jain___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
Re: [ceph-users] problem in ceph installation
please somebody help me in installing ceph. I am installing it on an Ubuntu 14.04 desktop VM. Currently, I am using the link http://eu.ceph.com/docs/wip-6919/start/quick-start/ But it's failed and I got following error W: Failed to fetch bzip2:/var/lib/apt/lists/partial/in.archive.ubuntu.com_ubuntu_dists_trusty-updates_main_binary-amd64_Packages Hash Sum mismatch Please help to resolve it. Regards Pragya Jain On Thursday, 17 July 2014 12:40 PM, pragya jain prag_2...@yahoo.co.in wrote: Hi all, I am installing ceph on ubuntu 14.04 desktop 64-bit VM using the link http://eu.ceph.com/docs/wip-6919/start/quick-start/ But I got following error while installing ceph - root@prag2648-VirtualBox:~# sudo apt-get update sudo apt-get install ceph Ign http://security.ubuntu.com trusty-security InRelease Ign http://in.archive.ubuntu.com trusty InRelease Hit http://security.ubuntu.com trusty-security Release.gpg Ign http://in.archive.ubuntu.com trusty-updates InRelease Hit http://security.ubuntu.com trusty-security Release Ign http://in.archive.ubuntu.com trusty-backports InRelease Hit http://in.archive.ubuntu.com trusty Release.gpg Hit http://security.ubuntu.com trusty-security/main Sources Hit http://in.archive.ubuntu.com trusty-updates Release.gpg Hit http://security.ubuntu.com trusty-security/restricted Sources Ign http://extras.ubuntu.com trusty InRelease Hit http://in.archive.ubuntu.com trusty-backports Release.gpg Hit http://security.ubuntu.com trusty-security/universe Sources Hit http://extras.ubuntu.com trusty Release.gpg Hit http://in.archive.ubuntu.com trusty Release Hit http://security.ubuntu.com trusty-security/multiverse Sources Hit http://extras.ubuntu.com trusty Release Hit http://in.archive.ubuntu.com trusty-updates Release Hit http://ceph.com trusty InRelease Hit http://extras.ubuntu.com trusty/main Sources Hit http://security.ubuntu.com trusty-security/main amd64 Packages Hit http://in.archive.ubuntu.com trusty-backports Release Hit http://extras.ubuntu.com trusty/main amd64 Packages Hit http://security.ubuntu.com trusty-security/restricted amd64 Packages Hit http://ceph.com trusty/main amd64 Packages Hit http://extras.ubuntu.com trusty/main i386 Packages Hit http://in.archive.ubuntu.com trusty/main Sources Hit http://security.ubuntu.com trusty-security/universe amd64 Packages Hit http://ceph.com trusty/main i386 Packages Hit http://in.archive.ubuntu.com trusty/restricted Sources Hit http://security.ubuntu.com trusty-security/multiverse amd64 Packages Hit http://in.archive.ubuntu.com trusty/universe Sources Hit http://security.ubuntu.com trusty-security/main i386 Packages Hit http://in.archive.ubuntu.com trusty/multiverse Sources Hit http://security.ubuntu.com trusty-security/restricted i386 Packages Hit http://in.archive.ubuntu.com trusty/main amd64 Packages Hit http://security.ubuntu.com trusty-security/universe i386 Packages Hit http://in.archive.ubuntu.com trusty/restricted amd64 Packages Hit http://security.ubuntu.com trusty-security/multiverse i386 Packages Ign http://extras.ubuntu.com trusty/main Translation-en_IN Hit http://in.archive.ubuntu.com trusty/universe amd64 Packages Ign http://extras.ubuntu.com trusty/main Translation-en Hit http://in.archive.ubuntu.com trusty/multiverse amd64 Packages Hit http://security.ubuntu.com trusty-security/main Translation-en Hit http://in.archive.ubuntu.com trusty/main i386 Packages Hit http://in.archive.ubuntu.com trusty/restricted i386 Packages Hit http://in.archive.ubuntu.com trusty/universe i386 Packages Hit http://in.archive.ubuntu.com trusty/multiverse i386 Packages Hit http://security.ubuntu.com trusty-security/restricted Translation-en Hit http://in.archive.ubuntu.com trusty/main Translation-en Hit http://security.ubuntu.com trusty-security/universe Translation-en Hit http://in.archive.ubuntu.com trusty/multiverse Translation-en Hit http://in.archive.ubuntu.com trusty/restricted Translation-en Hit http://in.archive.ubuntu.com trusty/universe Translation-en Hit http://in.archive.ubuntu.com trusty-updates/main Sources Hit http://in.archive.ubuntu.com trusty-updates/restricted Sources Ign http://ceph.com trusty/main Translation-en_IN Hit http://in.archive.ubuntu.com trusty-updates/universe Sources Hit http://in.archive.ubuntu.com trusty-updates/multiverse Sources Ign http://ceph.com trusty/main Translation-en Get:1 http://in.archive.ubuntu.com trusty-updates/main amd64 Packages [218 kB] Hit http://security.ubuntu.com trusty-security/multiverse Translation-en Ign http://security.ubuntu.com trusty-security/main Translation-en_IN Ign http://security.ubuntu.com trusty-security/multiverse Translation-en_IN Ign
[ceph-users] problem in ceph installation
-updates/restricted i386 Packages [14 B] Get:7 http://in.archive.ubuntu.com trusty-updates/universe i386 Packages [155 kB] Get:8 http://in.archive.ubuntu.com trusty-updates/multiverse i386 Packages [7,587 B] Hit http://in.archive.ubuntu.com trusty-updates/main Translation-en Hit http://in.archive.ubuntu.com trusty-updates/multiverse Translation-en Hit http://in.archive.ubuntu.com trusty-updates/restricted Translation-en Hit http://in.archive.ubuntu.com trusty-updates/universe Translation-en Get:9 http://in.archive.ubuntu.com trusty-backports/main Sources [1,232 B] Get:10 http://in.archive.ubuntu.com trusty-backports/restricted Sources [14 B] Get:11 http://in.archive.ubuntu.com trusty-backports/universe Sources [9,234 B] Get:12 http://in.archive.ubuntu.com trusty-backports/multiverse Sources [768 B] Get:13 http://in.archive.ubuntu.com trusty-backports/main amd64 Packages [2,240 B] Get:14 http://in.archive.ubuntu.com trusty-backports/restricted amd64 Packages [14 B] Get:15 http://in.archive.ubuntu.com trusty-backports/universe amd64 Packages [11.0 kB] Get:16 http://in.archive.ubuntu.com trusty-backports/multiverse amd64 Packages [619 B] Get:17 http://in.archive.ubuntu.com trusty-backports/main i386 Packages [2,239 B] Get:18 http://in.archive.ubuntu.com trusty-backports/restricted i386 Packages [14 B] Get:19 http://in.archive.ubuntu.com trusty-backports/universe i386 Packages [11.0 kB] Get:20 http://in.archive.ubuntu.com trusty-backports/multiverse i386 Packages [619 B] Hit http://in.archive.ubuntu.com trusty-backports/main Translation-en Hit http://in.archive.ubuntu.com trusty-backports/multiverse Translation-en Hit http://in.archive.ubuntu.com trusty-backports/restricted Translation-en Hit http://in.archive.ubuntu.com trusty-backports/universe Translation-en Ign http://in.archive.ubuntu.com trusty/main Translation-en_IN Ign http://in.archive.ubuntu.com trusty/multiverse Translation-en_IN Ign http://in.archive.ubuntu.com trusty/restricted Translation-en_IN Ign http://in.archive.ubuntu.com trusty/universe Translation-en_IN Ign http://in.archive.ubuntu.com trusty-updates/main Translation-en_IN Ign http://in.archive.ubuntu.com trusty-updates/multiverse Translation-en_IN Ign http://in.archive.ubuntu.com trusty-updates/restricted Translation-en_IN Ign http://in.archive.ubuntu.com trusty-updates/universe Translation-en_IN Ign http://in.archive.ubuntu.com trusty-backports/main Translation-en_IN Ign http://in.archive.ubuntu.com trusty-backports/multiverse Translation-en_IN Ign http://in.archive.ubuntu.com trusty-backports/restricted Translation-en_IN Ign http://in.archive.ubuntu.com trusty-backports/universe Translation-en_IN Fetched 801 kB in 1min 4s (12.4 kB/s) W: Failed to fetch bzip2:/var/lib/apt/lists/partial/in.archive.ubuntu.com_ubuntu_dists_trusty-updates_main_binary-amd64_Packages Hash Sum mismatch W: Failed to fetch bzip2:/var/lib/apt/lists/partial/in.archive.ubuntu.com_ubuntu_dists_trusty-updates_universe_binary-amd64_Packages Hash Sum mismatch W: Failed to fetch bzip2:/var/lib/apt/lists/partial/in.archive.ubuntu.com_ubuntu_dists_trusty-updates_main_binary-i386_Packages Hash Sum mismatch W: Failed to fetch bzip2:/var/lib/apt/lists/partial/in.archive.ubuntu.com_ubuntu_dists_trusty-updates_universe_binary-i386_Packages Hash Sum mismatch E: Some index files failed to download. They have been ignored, or old ones used instead. --- What should I do to resolve this problem? Please help in this regard. Pragya Jain ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
Re: [ceph-users] basic questions about pool
thank you very much, Karan, for your explanation. Regards Pragya Jain On Tuesday, 15 July 2014 1:53 PM, Karan Singh karan.si...@csc.fi wrote: Hi Pragya Let me try to answer these. 1# The decisions is based on your use case ( performance , reliability ) .If you need high performance out of your cluster , the deployer will create a pool on SSD and assign this pool to applications which require higher I/O. For Ex : if you integrate openstack with Ceph , you can instruct openstack configuration files to write data to a specific ceph pool. (http://ceph.com/docs/master/rbd/rbd-openstack/#configuring-glance) , similarly you can instruct CephFS and RadosGW with pool to use for data storage. 2# Usually the end user (client to ceph cluster) does not bother about where the data is getting stored , which pool its using , and what is the real physical locate of data. End user will demand for specific performance , reliability and availability. It is the job of Ceph admin to fulfil their storage requirements, out of Ceph functionalities of SSD , Erausre codes , replication level etc. Block Device :- End user will instruct the application ( Qemu / KVM , OpenStack etc ) , which pool it should for data storage. rbd is the default pool for block device. CephFS :- End user will mount this pool as filesystem and can use further. Default pool are data and metadata . RadosGW :- End user will storage objects using S3 or Swift API. - Karan Singh - On 15 Jul 2014, at 07:42, pragya jain prag_2...@yahoo.co.in wrote: thank you very much, Craig, for your clear explanation against my questions. Now I am very clear about the concept of pools in ceph. But I have two small questions: 1. How does the deployer decide that a particular type of information will be stored in a particular pool? Are there any settings at the time of creation of pool that a deployer should make to ensure that which type of data will be stored in which pool? 2. How does an end-user specify that his/her data will be stored in which pool? how can an end-user come to know which pools are stored on SSDs or on HDDs, what are the properties of a particular pool? Thanks again, Please help to clear these confusions also. Regards Pragya Jain On Sunday, 13 July 2014 5:04 AM, Craig Lewis cle...@centraldesktop.com wrote: I'll answer out of order. #2: rdb is used for RDB images. data and metadata are used by CephFS. RadosGW's default pools will be created the first time radosgw starts up. If you aren't using RDB or CephFS, you can ignore those pools. #1: RadosGW will use several pools to segregate it's data. There are a couple pools for store user/subuser information, as well as pools for storing the actual data. I'm using federation, and I have a total of 18 pools that RadosGW is using in some form. Pools are a way to logically separate your data, and pools can also have different replication/storage settings. For example, I could say that the .rgw.buckets.index pool needs 4x replication and is only stored on SSDs, while .rgw.bucket is 3x replication on HDDs. #3: In addition to #1, you can setup different pools to actually store user data in RadosGW. For example, an end user may have some very important data that you want replicated 4 times, and some other data that needs to be stored on SSDs for low latency. Using CRUSH, you would create the some rados pools with those specs. Then you'd setup some placement targets in RadosGW that use those pools. A user that cares will specify a placement target when they create a bucket. That way they can decide what the storage requirements are. If they don't care, then they can just use the default. Does that help? On Thu, Jul 10, 2014 at 11:34 PM, pragya jain prag_2...@yahoo.co.in wrote: hi all, I have some very basic questions about pools in ceph. According to ceph documentation, as we deploy a ceph cluster with radosgw instance over it, ceph creates pool by default to store the data or the deployer can also create pools according to the requirement. Now, my question is: 1. what is the relevance of multiple pools in a cluster? i.e. why should a deployer create multiple pools in a cluster? what should be the benefits of creating multiple pools? 2. according to the docs, the default pools are data, metadata, and rbd. what is the difference among these three types of pools? 3. when a system deployer has deployed a ceph cluster with radosgw interface and start providing services to the end-user, such as, end-user can create their account on the ceph cluster and can store/retrieve their data to/from the cluster, then Is the end user has any concern about the pools created in the cluster? Please somebody help me to clear these confusions. regards Pragya Jain ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users
[ceph-users] basic questions about pool
hi all, I have some very basic questions about pools in ceph. According to ceph documentation, as we deploy a ceph cluster with radosgw instance over it, ceph creates pool by default to store the data or the deployer can also create pools according to the requirement. Now, my question is: 1. what is the relevance of multiple pools in a cluster? i.e. why should a deployer create multiple pools in a cluster? what should be the benefits of creating multiple pools? 2. according to the docs, the default pools are data, metadata, and rbd. what is the difference among these three types of pools? 3. when a system deployer has deployed a ceph cluster with radosgw interface and start providing services to the end-user, such as, end-user can create their account on the ceph cluster and can store/retrieve their data to/from the cluster, then Is the end user has any concern about the pools created in the cluster? Please somebody help me to clear these confusions. regards Pragya Jain___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
[ceph-users] external monitoring tools for ceph
Hello all, I am working on ceph storage cluster with rados gateway for object storage. I am looking for external monitoring tools that can be used to monitor ceph storage cluster and rados gateway interface. I find various monitoring tools, such as nagios, collectd, ganglia, diamond, sensu, logstash. but i don't get details of anyone about what features do these monitoring tools monitor in ceph. Has somebody implemented anyone of these tools? Can somebody help me in identifying the features provided by these tools? Is there any other tool which can also be used to monitor ceph specially for object storage? Regards Pragya Jain___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
