Re: [ceph-users] Calamari Deployment
For that matter, is there a way to build Calamari without going the whole vagrant path at all? Some way of just building it through command-line tools? I would be building it on an Openstack instance, no GUI. Seems silly to have to install an entire virtualbox environment inside something that’s already a VM. From: ceph-users [mailto:ceph-users-boun...@lists.ceph.com] On Behalf Of JESUS CHAVEZ ARGUELLES Sent: Monday, March 02, 2015 3:00 PM To: ceph-users@lists.ceph.com Subject: [ceph-users] Calamari Deployment Does anybody know how to succesful install Calamari in rhel7 ? I have tried the vagrant thug without sucesss and it seems like a nightmare there is a Kind of Sidur when you do vagrant up where it seems not to find the vm path... Regards Jesus Chavez SYSTEMS ENGINEER-C.SALES jesch...@cisco.commailto:jesch...@cisco.com Phone: +52 55 5267 3146tel:+52%2055%205267%203146 Mobile: +51 1 5538883255tel:+51%201%205538883255 CCIE - 44433 -- CONFIDENTIALITY NOTICE: If you have received this email in error, please immediately notify the sender by e-mail at the address shown. This email transmission may contain confidential information. This information is intended only for the use of the individual(s) or entity to whom it is intended even if addressed incorrectly. Please delete it from your files if you are not the intended recipient. Thank you for your compliance. Copyright (c) 2015 Cigna == ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
Re: [ceph-users] Calamari Deployment
Well, we’re a RedHat shop, so I’ll have to see what’s adaptable from there. (Mint on all my home systems, so I’m not totally lost with Ubuntu g) From: Quentin Hartman [mailto:qhart...@direwolfdigital.com] Sent: Thursday, March 26, 2015 1:15 PM To: Steffen W Sørensen Cc: LaBarre, James (CTR) A6IT; ceph-users@lists.ceph.com Subject: Re: [ceph-users] Calamari Deployment I used this as a guide for building calamari packages w/o using vagrant. Worked great: http://bryanapperson.com/blog/compiling-calamari-ceph-ubuntu-14-04/https://urldefense.proofpoint.com/v2/url?u=http-3A__bryanapperson.com_blog_compiling-2Dcalamari-2Dceph-2Dubuntu-2D14-2D04_d=AwMFaQc=WlnXFIBCT3pmNh_w8hYeLwr=wHASSrXLcneWpRUvkiFE4YeL1dd09LRRfqfW2SnLvVkm=LYJ7jurZXFUR0O0z7RQYmQwoJoI0lxM2z_KcwZyyG2As=VvuP1JebIkqFQQX3vQpQloFGkt_O00GkCSDehbFQjKQe= On Thu, Mar 26, 2015 at 10:30 AM, Steffen W Sørensen ste...@me.commailto:ste...@me.com wrote: On 26/03/2015, at 17.18, LaBarre, James (CTR) A6IT james.laba...@cigna.commailto:james.laba...@cigna.com wrote: For that matter, is there a way to build Calamari without going the whole vagrant path at all? Some way of just building it through command-line tools? I would be building it on an Openstack instance, no GUI. Seems silly to have to install an entire virtualbox environment inside something that’s already a VM. Agreed... if U wanted to built in on your server farm/cloud stack env. I just built my packages for Debian Wheezy (with CentOS+RHEL rpms as a bonus) on my desktop Mac/OS-X with use of virtualbox and vagrant ( vagrant is an easy disposable built-env:) From: ceph-users [mailto:ceph-users-boun...@lists.ceph.com] On Behalf Of JESUS CHAVEZ ARGUELLES Sent: Monday, March 02, 2015 3:00 PM To: ceph-users@lists.ceph.commailto:ceph-users@lists.ceph.com Subject: [ceph-users] Calamari Deployment Does anybody know how to succesful install Calamari in rhel7 ? I have tried the vagrant thug without sucesss and it seems like a nightmare there is a Kind of Sidur when you do vagrant up where it seems not to find the vm path... Regards Jesus Chavez SYSTEMS ENGINEER-C.SALES jesch...@cisco.commailto:jesch...@cisco.com Phone: +52 55 5267 3146tel:+52%2055%205267%203146 Mobile: +51 1 5538883255tel:+51%201%205538883255 CCIE - 44433 -- CONFIDENTIALITY NOTICE: If you have received this email in error, please immediately notify the sender by e-mail at the address shown. This email transmission may contain confidential information. This information is intended only for the use of the individual(s) or entity to whom it is intended even if addressed incorrectly. Please delete it from your files if you are not the intended recipient. Thank you for your compliance. Copyright (c) 2015 Cigna == ___ ceph-users mailing list ceph-users@lists.ceph.commailto:ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.comhttps://urldefense.proofpoint.com/v2/url?u=http-3A__lists.ceph.com_listinfo.cgi_ceph-2Dusers-2Dceph.comd=AwMFaQc=WlnXFIBCT3pmNh_w8hYeLwr=wHASSrXLcneWpRUvkiFE4YeL1dd09LRRfqfW2SnLvVkm=LYJ7jurZXFUR0O0z7RQYmQwoJoI0lxM2z_KcwZyyG2As=Xrs2jkzW8YBGyou7WMawVR5OqIS1cPaVO5MW-YIo4XAe= ___ ceph-users mailing list ceph-users@lists.ceph.commailto:ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.comhttps://urldefense.proofpoint.com/v2/url?u=http-3A__lists.ceph.com_listinfo.cgi_ceph-2Dusers-2Dceph.comd=AwMFaQc=WlnXFIBCT3pmNh_w8hYeLwr=wHASSrXLcneWpRUvkiFE4YeL1dd09LRRfqfW2SnLvVkm=LYJ7jurZXFUR0O0z7RQYmQwoJoI0lxM2z_KcwZyyG2As=Xrs2jkzW8YBGyou7WMawVR5OqIS1cPaVO5MW-YIo4XAe= -- CONFIDENTIALITY NOTICE: If you have received this email in error, please immediately notify the sender by e-mail at the address shown. This email transmission may contain confidential information. This information is intended only for the use of the individual(s) or entity to whom it is intended even if addressed incorrectly. Please delete it from your files if you are not the intended recipient. Thank you for your compliance. Copyright (c) 2015 Cigna == ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
[ceph-users] Reassigning admin server
If I have a machine/VM I am using as an Admin node for a ceph cluster, can I relocate that admin to another machine/VM after I've built a cluster? I would expect as the Admin isn't an actual operating part of the cluster itself (other than Calamari, if it happens to be running) the rest of the cluster should be adequately served with a -update-conf. -- CONFIDENTIALITY NOTICE: If you have received this email in error, please immediately notify the sender by e-mail at the address shown. This email transmission may contain confidential information. This information is intended only for the use of the individual(s) or entity to whom it is intended even if addressed incorrectly. Please delete it from your files if you are not the intended recipient. Thank you for your compliance. Copyright (c) 2014 Cigna == ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
[ceph-users] Removing MDS
We were building a test cluster here, and I enabled MDS in order to use ceph-fuse to fill the cluster with data. It seems the metadata server is having problems, so I figured I'd just remove it and rebuild it. However, the ceph-deploy mds destroy command is not implemented; it appears that once you have created an MDS, you can't get rid of it without demolishing your entire cluster and building from scratch. And since the cluster is already out of whack, there seems to be no way to even drop OSDs to restart it cleanly. Should I just reboot all the OSD nodes and the monitor node, and hope the cluster comes up in a usable fashion? Because there seems no other option short of the burn-down and rebuild. -- CONFIDENTIALITY NOTICE: If you have received this email in error, please immediately notify the sender by e-mail at the address shown. This email transmission may contain confidential information. This information is intended only for the use of the individual(s) or entity to whom it is intended even if addressed incorrectly. Please delete it from your files if you are not the intended recipient. Thank you for your compliance. Copyright (c) 2014 Cigna == ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
[ceph-users] Map-view of PGs
Is there a tool to show a the layout of PGs in a cluster (which OSD/node that duplicate PGs are placed in? Something like a table with the PG number on one side, and columns representing nodes/OSDs, with the OSD containing a PG filled in/marked? -- CONFIDENTIALITY NOTICE: If you have received this email in error, please immediately notify the sender by e-mail at the address shown. This email transmission may contain confidential information. This information is intended only for the use of the individual(s) or entity to whom it is intended even if addressed incorrectly. Please delete it from your files if you are not the intended recipient. Thank you for your compliance. Copyright (c) 2014 Cigna == ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
[ceph-users] Install from alternate repo
I was trying to install the development version of Ceph (0.84) on a cluster, using ceph-deploy and trying not to have to copy in repo files and other hacks onto the mon/OSD nodes. The problem is, it seems to presume it knows the right URL to install from, and it's not taking the settings from the ceph.repo file on the admin node. Even though I have the Ceph repository configured on the Admin node to use https://ceph.com/rpm-testing/rhel6/noarch and https://ceph.com/rpm-testing/rhel6/x86_64, if I do a ceph-deploy install node list, it insists on looking to the Firefly version, and also tries to install over http (our test machines will *only* install from https outside the firewall, our regular systems would have to install from Satellite internally). There needs to be a way to force ceph-deploy to use an alternative install path. Installed Packages ceph-deploy.noarch 1.5.13-0 @ceph-devel-noarch Available Packages ceph.x86_64 0.84-0.el6 ceph-devel-x64 ceph-common.x86_64 0.84-0.el6 ceph-devel-x64 ceph-debuginfo.x86_64 0.84-0.el6 ceph-devel-x64 ceph-devel.x86_64 0.84-0.el6 ceph-devel-x64 ceph-fuse.x86_64 0.84-0.el6 ceph-devel-x64 ceph-radosgw.x86_64 0.84-0.el6 ceph-devel-x64 ceph-release.noarch 1-0.rhel6 ceph-devel-noarch ceph-test.x86_64 0.84-0.el6 ceph-devel-x64 cephfs-java.x86_64 0.84-0.el6 ceph-devel-x64 -- CONFIDENTIALITY NOTICE: If you have received this email in error, please immediately notify the sender by e-mail at the address shown. This email transmission may contain confidential information. This information is intended only for the use of the individual(s) or entity to whom it is intended even if addressed incorrectly. Please delete it from your files if you are not the intended recipient. Thank you for your compliance. Copyright (c) 2014 Cigna == ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
[ceph-users] RAID underlying a Ceph config
Having heard some suggestions on RAID configuration under Gluster (we have someone else doing that evaluation, I'm doing the Ceph piece), I'm wondering what (if any) RAID configurations would be recommended for Ceph. I have the impression that striping data could counteract/undermine data replication (with PGs potentially being on multiple disks, rather than within a single disk-oriented OSD). -- CONFIDENTIALITY NOTICE: If you have received this email in error, please immediately notify the sender by e-mail at the address shown. This email transmission may contain confidential information. This information is intended only for the use of the individual(s) or entity to whom it is intended even if addressed incorrectly. Please delete it from your files if you are not the intended recipient. Thank you for your compliance. Copyright (c) 2014 Cigna == ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
[ceph-users] MSWin CephFS
Just out of curiosity, is there a way to mount a Ceph filesystem directly on a MSWindows system (2008 R2 server)? Just wanted to try something out from a VM. -- CONFIDENTIALITY NOTICE: If you have received this email in error, please immediately notify the sender by e-mail at the address shown. This email transmission may contain confidential information. This information is intended only for the use of the individual(s) or entity to whom it is intended even if addressed incorrectly. Please delete it from your files if you are not the intended recipient. Thank you for your compliance. Copyright (c) 2014 Cigna == ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
Re: [ceph-users] Ceph-fuse fails to mount
The problem I've encountered now is figuring just what it wants for various fields. I've tried some values for the ceph fs new command, and it apparently wants some specific metadata and data values, and I have no idea what it needs (I'm pretty much the only person working with Ceph here at the moment) If I run the exact command you have on the website (I tried setting to some values meaningful to my test env previously, with the same results) $ ceph fs new cephfs cephfs_metadata cephfs_data Error ENOENT: pool 'cephfs_metadata' does not exist -Original Message- From: Gregory Farnum [mailto:g...@inktank.com] Sent: Tuesday, August 26, 2014 4:28 PM To: LaBarre, James (CTR) A6IT; ceph-users Subject: Re: [ceph-users] Ceph-fuse fails to mount [Re-added the list.] I believe you'll find everything you need at http://ceph.com/docs/master/cephfs/createfs/ -Greg Software Engineer #42 @ http://inktank.com | http://ceph.com -- CONFIDENTIALITY NOTICE: If you have received this email in error, please immediately notify the sender by e-mail at the address shown. This email transmission may contain confidential information. This information is intended only for the use of the individual(s) or entity to whom it is intended even if addressed incorrectly. Please delete it from your files if you are not the intended recipient. Thank you for your compliance. Copyright (c) 2014 Cigna == ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
Re: [ceph-users] Ceph-fuse fails to mount
Never mind, I found it (ceph osd lspools). And since it was just one set of data/metadata, those were the values. -Original Message- From: LaBarre, James (CTR) A6IT Sent: Wednesday, August 27, 2014 10:04 AM To: 'Gregory Farnum'; ceph-users Subject: RE: [ceph-users] Ceph-fuse fails to mount The problem I've encountered now is figuring just what it wants for various fields. I've tried some values for the ceph fs new command, and it apparently wants some specific metadata and data values, and I have no idea what it needs (I'm pretty much the only person working with Ceph here at the moment) If I run the exact command you have on the website (I tried setting to some values meaningful to my test env previously, with the same results) $ ceph fs new cephfs cephfs_metadata cephfs_data Error ENOENT: pool 'cephfs_metadata' does not exist -Original Message- From: Gregory Farnum [mailto:g...@inktank.com] Sent: Tuesday, August 26, 2014 4:28 PM To: LaBarre, James (CTR) A6IT; ceph-users Subject: Re: [ceph-users] Ceph-fuse fails to mount [Re-added the list.] I believe you'll find everything you need at http://ceph.com/docs/master/cephfs/createfs/ -Greg Software Engineer #42 @ http://inktank.com | http://ceph.com -- CONFIDENTIALITY NOTICE: If you have received this email in error, please immediately notify the sender by e-mail at the address shown. This email transmission may contain confidential information. This information is intended only for the use of the individual(s) or entity to whom it is intended even if addressed incorrectly. Please delete it from your files if you are not the intended recipient. Thank you for your compliance. Copyright (c) 2014 Cigna == ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
[ceph-users] Ceph-fuse fails to mount
I have built a couple of ceph test clusters, and am attempting to mount the
storage through ceph-fuse on a RHEL 6.4 VM (the clusters are also in VMs). The
first one I built under v0.80, using directories for the ceph OSDs (as per the
Storage Cluster Quick Start at
http://ceph.com/docs/master/start/quick-ceph-deploy/ ). The second is built
under v0.84, using the disks directly for OSDs.I have the keyring files for
each available on the client node, and copy in the appropriate one when I try
mounting.
The first cluster will mount with no problem, and I can read and write to it.
If I try to mount the second cluster instead (copying in the keyring file and a
ceph.conf with the appropriate mon node info), ceph-fuse gets as far as
starting ceph client, and never gets any further. I could leave it there for
half an hour (ran the command and went to get lunch) and it never completes.
The status command shows each cluster as healthy.
[ceph@first_cluster ~]$ ceph -s
cluster e0433b49-d64c-4c3e-8ad9-59a47d84142d
health HEALTH_OK
monmap e1: 1 mons at {first_cluster=10.25.164.192:6789/0}, election epoch
2, quorum 0 first_cluster
mdsmap e4: 1/1/1 up {0=first_cluster=up:active}
osdmap e13: 3 osds: 3 up, 3 in
pgmap v480: 192 pgs, 3 pools, 1417 MB data, 4851 objects
19835 MB used, 56927 MB / 76762 MB avail
192 active+clean
[ceph@second_cluster ~]$ ceph -s
cluster 06f655b7-e147-4790-ad52-c57dcbf160b7
health HEALTH_OK
monmap e1: 1 mons at {second_cluster=10.25.165.91:6789/0}, election epoch
1, quorum 0 cilsdbxd1768
osdmap e16: 7 osds: 7 up, 7 in
pgmap v539: 192 pgs, 3 pools, 0 bytes data, 0 objects
252 MB used, 194 GB / 194 GB avail
192 active+clean
--
CONFIDENTIALITY NOTICE: If you have received this email in error,
please immediately notify the sender by e-mail at the address shown.
This email transmission may contain confidential information. This
information is intended only for the use of the individual(s) or entity to
whom it is intended even if addressed incorrectly. Please delete it from
your files if you are not the intended recipient. Thank you for your
compliance. Copyright (c) 2014 Cigna
==
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
[ceph-users] Question on OSD node failure recovery
I understand the concept with Ceph being able to recover from the failure of an OSD (presumably with a single OSD being on a single disk), but I'm wondering what the scenario is if an OSD server node containing multiple disks should fail. Presuming you have a server containing 8-10 disks, your duplicated placement groups could end up on the same system. From diagrams I've seen they show duplicates going to separate nodes, but is this in fact how it handles it? -- CONFIDENTIALITY NOTICE: If you have received this email in error, please immediately notify the sender by e-mail at the address shown. This email transmission may contain confidential information. This information is intended only for the use of the individual(s) or entity to whom it is intended even if addressed incorrectly. Please delete it from your files if you are not the intended recipient. Thank you for your compliance. Copyright (c) 2014 Cigna == ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
Re: [ceph-users] v0.84 released
Is there a repo for this version which works over HTTPS? Because of the corporate firewall, I can’t install through regular HTTP. -- CONFIDENTIALITY NOTICE: If you have received this email in error, please immediately notify the sender by e-mail at the address shown. This email transmission may contain confidential information. This information is intended only for the use of the individual(s) or entity to whom it is intended even if addressed incorrectly. Please delete it from your files if you are not the intended recipient. Thank you for your compliance. Copyright (c) 2014 Cigna == ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
Re: [ceph-users] v0.84 released
Nope, that one works. I just had a different source server, and couldn't find what the path would be on the main server (not very well documented). It looks to have updated properly. Updating my test configuration now. -Original Message- From: Alfredo Deza [mailto:alfredo.d...@inktank.com] Sent: Tuesday, August 19, 2014 1:00 PM To: LaBarre, James (CTR) A6IT Cc: ceph-us...@ceph.com Subject: Re: [ceph-users] v0.84 released Both: https://ceph.com/debian-testing/ and https://ceph.com/rpm-testing/ seem to work for me. Are you seeing some error? On Tue, Aug 19, 2014 at 11:57 AM, LaBarre, James (CTR) A6IT james.laba...@cigna.com wrote: Is there a repo for this version which works over HTTPS? Because of the corporate firewall, I can’t install through regular HTTP. -- CONFIDENTIALITY NOTICE: If you have received this email in error, please immediately notify the sender by e-mail at the address shown. This email transmission may contain confidential information. This information is intended only for the use of the individual(s) or entity to whom it is intended even if addressed incorrectly. Please delete it from your files if you are not the intended recipient. Thank you for your compliance. Copyright (c) 2014 Cigna == ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com -- CONFIDENTIALITY NOTICE: If you have received this email in error, please immediately notify the sender by e-mail at the address shown. This email transmission may contain confidential information. This information is intended only for the use of the individual(s) or entity to whom it is intended even if addressed incorrectly. Please delete it from your files if you are not the intended recipient. Thank you for your compliance. Copyright (c) 2014 Cigna == ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
