[ceph-users] Unable to see LTTng tracepoints in Ceph
Hello Cephers, A very happy new year to you all! I wanted to enable LTTng tracepoints for a few tests with infernalis and configured Ceph with the -with-lttng option. Seeing a recent post on conf file options for tracing, I added these lines: osd_tracing = true osd_objectstore_tracing = true rados_tracing = true rbd_tracing = true However, I am unable to see LTTng tracepoints within ceph-osd. I can see tracepoints in ceph-mon though. The main difference with respect to tracing between ceph-mon and ceph-osd seems to be TracepointProvider and I thought the addition in my config file should do the trick but that didn't change anything. I do not know if this is relevant but I also checked with lsof and I see ceph-osd is accessing the lttng library as is ceph-mon. Did anyone come across this issue and if so, could you give me some direction on this? Thanks a lot for your help! Aakanksha ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
Re: [ceph-users] Cannot create Initial Monitor
Thanks a lot for your help, Varada. Since I was deploying Ceph via ceph-deploy I could not see the actual errors. Low disk space led to a failure in creating monfs. Things are now working fine. Thanks, Aakanksha From: Varada Kari [mailto:varada.k...@sandisk.com] Sent: Tuesday, December 08, 2015 9:04 PM To: Aakanksha Pudipeddi-SSI; ceph-users Subject: RE: Cannot create Initial Monitor Could you try starting the monitor manually and see what the error is? Like ceph-mon -i --cluster ceph &. Enable more logging (debug_mon). Varada From: ceph-users [mailto:ceph-users-boun...@lists.ceph.com] On Behalf Of Aakanksha Pudipeddi-SSI Sent: Wednesday, December 09, 2015 7:47 AM To: Aakanksha Pudipeddi-SSI <aakanksha...@ssi.samsung.com<mailto:aakanksha...@ssi.samsung.com>>; ceph-users <ceph-us...@ceph.com<mailto:ceph-us...@ceph.com>> Subject: Re: [ceph-users] Cannot create Initial Monitor I am still unable to get past this issue. Could anyone help me out here? Thanks, Aakanksha From: ceph-users [mailto:ceph-users-boun...@lists.ceph.com] On Behalf Of Aakanksha Pudipeddi-SSI Sent: Thursday, December 03, 2015 8:08 PM To: ceph-users Subject: [ceph-users] Cannot create Initial Monitor Hello Cephers, I am unable to create the initial monitor during ceph cluster deployment. I do not know what changed since the same recipe used to work until very recently. These are the steps I used: Ceph-deploy new -- works Dpkg -i -R --works Ceph-deploy mon create-initial - fails Log: [ceph_deploy.cli][INFO ] Invoked (1.5.28): /usr/bin/ceph-deploy mon create-initial [ceph_deploy.cli][INFO ] ceph-deploy options: [ceph_deploy.cli][INFO ] username : None [ceph_deploy.cli][INFO ] verbose : False [ceph_deploy.cli][INFO ] overwrite_conf: False [ceph_deploy.cli][INFO ] subcommand: create-initial [ceph_deploy.cli][INFO ] quiet : False [ceph_deploy.cli][INFO ] cd_conf : [ceph_deploy.cli][INFO ] cluster : ceph [ceph_deploy.cli][INFO ] func : [ceph_deploy.cli][INFO ] ceph_conf : None [ceph_deploy.cli][INFO ] default_release : False [ceph_deploy.cli][INFO ] keyrings : None [ceph_deploy.mon][DEBUG ] Deploying mon, cluster ceph hosts myhost [ceph_deploy.mon][DEBUG ] detecting platform for host myhost ... [Myhost][DEBUG ] connection detected need for sudo [Myhost][DEBUG ] connected to host: myhost [Myhost][DEBUG ] detect platform information from remote host [Myhost][DEBUG ] detect machine type [Myhost][DEBUG ] find the location of an executable [ceph_deploy.mon][INFO ] distro info: Ubuntu 14.04 trusty [Myhost][DEBUG ] determining if provided host has same hostname in remote [Myhost][DEBUG ] get remote short hostname [Myhost][DEBUG ] deploying mon to myhost [Myhost][DEBUG ] get remote short hostname [Myhost][DEBUG ] remote hostname: myhost [Myhost][DEBUG ] write cluster configuration to /etc/ceph/{cluster}.conf [Myhost][DEBUG ] create the mon path if it does not exist [Myhost][DEBUG ] checking for done path: /var/lib/ceph/mon/ceph-myhost/done [Myhost][DEBUG ] done path does not exist: /var/lib/ceph/mon/ceph-myhost/done [Myhost][INFO ] creating keyring file: /var/lib/ceph/tmp/ceph-myhost.mon.keyring [Myhost][DEBUG ] create the monitor keyring file [Myhost][INFO ] Running command: sudo ceph-mon --cluster ceph --mkfs -i myhost --keyring /var/lib/ceph/tmp/ceph-myhost.mon.keyring [Myhost][DEBUG ] ceph-mon: renaming mon.noname-a xx.xx.xxx.xx:6789/0 to mon.myhost [Myhost][DEBUG ] ceph-mon: set fsid to 5573b0c6-02fd-4c45-aa89-b88fd08b3b87 [Myhost][DEBUG ] ceph-mon: created monfs at /var/lib/ceph/mon/ceph-myhost for mon.myhost [Myhost][INFO ] unlinking keyring file /var/lib/ceph/tmp/ceph-myhost.mon.keyring [Myhost][DEBUG ] create a done file to avoid re-doing the mon deployment [Myhost][DEBUG ] create the init path if it does not exist [Myhost][DEBUG ] locating the `service` executable... [Myhost][INFO ] Running command: sudo initctl emit ceph-mon cluster=ceph id=myhost [Myhost][INFO ] Running command: sudo ceph --cluster=ceph --admin-daemon /var/run/ceph/ceph-mon.myhost.asok mon_status [Myhost][ERROR ] admin_socket: exception getting command descriptions: [Errno 2] No such file or directory [Myhost][WARNING] monitor: mon.myhost, might not be running yet I checked the monitor log in /var/log/ceph and it does not have anything unusual, just the pid for the ceph-mon process. However, there is no /var/run/ceph/ceph-mon.myhost.asok. I do not know in which step this file is created; hence I am not able to debug this issue. Any pointers wrt this issue would be appreciated. I am using the BLKIN Ceph branch (wip-blkin) i.e. 9.0.1 Ceph packages built from source and my ceph-deploy version is 1.5.28. Thanks, Aakanksha __
Re: [ceph-users] Cannot create Initial Monitor
I am still unable to get past this issue. Could anyone help me out here? Thanks, Aakanksha From: ceph-users [mailto:ceph-users-boun...@lists.ceph.com] On Behalf Of Aakanksha Pudipeddi-SSI Sent: Thursday, December 03, 2015 8:08 PM To: ceph-users Subject: [ceph-users] Cannot create Initial Monitor Hello Cephers, I am unable to create the initial monitor during ceph cluster deployment. I do not know what changed since the same recipe used to work until very recently. These are the steps I used: Ceph-deploy new -- works Dpkg -i -R --works Ceph-deploy mon create-initial - fails Log: [ceph_deploy.cli][INFO ] Invoked (1.5.28): /usr/bin/ceph-deploy mon create-initial [ceph_deploy.cli][INFO ] ceph-deploy options: [ceph_deploy.cli][INFO ] username : None [ceph_deploy.cli][INFO ] verbose : False [ceph_deploy.cli][INFO ] overwrite_conf: False [ceph_deploy.cli][INFO ] subcommand: create-initial [ceph_deploy.cli][INFO ] quiet : False [ceph_deploy.cli][INFO ] cd_conf : [ceph_deploy.cli][INFO ] cluster : ceph [ceph_deploy.cli][INFO ] func : [ceph_deploy.cli][INFO ] ceph_conf : None [ceph_deploy.cli][INFO ] default_release : False [ceph_deploy.cli][INFO ] keyrings : None [ceph_deploy.mon][DEBUG ] Deploying mon, cluster ceph hosts myhost [ceph_deploy.mon][DEBUG ] detecting platform for host myhost ... [Myhost][DEBUG ] connection detected need for sudo [Myhost][DEBUG ] connected to host: myhost [Myhost][DEBUG ] detect platform information from remote host [Myhost][DEBUG ] detect machine type [Myhost][DEBUG ] find the location of an executable [ceph_deploy.mon][INFO ] distro info: Ubuntu 14.04 trusty [Myhost][DEBUG ] determining if provided host has same hostname in remote [Myhost][DEBUG ] get remote short hostname [Myhost][DEBUG ] deploying mon to myhost [Myhost][DEBUG ] get remote short hostname [Myhost][DEBUG ] remote hostname: myhost [Myhost][DEBUG ] write cluster configuration to /etc/ceph/{cluster}.conf [Myhost][DEBUG ] create the mon path if it does not exist [Myhost][DEBUG ] checking for done path: /var/lib/ceph/mon/ceph-myhost/done [Myhost][DEBUG ] done path does not exist: /var/lib/ceph/mon/ceph-myhost/done [Myhost][INFO ] creating keyring file: /var/lib/ceph/tmp/ceph-myhost.mon.keyring [Myhost][DEBUG ] create the monitor keyring file [Myhost][INFO ] Running command: sudo ceph-mon --cluster ceph --mkfs -i myhost --keyring /var/lib/ceph/tmp/ceph-myhost.mon.keyring [Myhost][DEBUG ] ceph-mon: renaming mon.noname-a xx.xx.xxx.xx:6789/0 to mon.myhost [Myhost][DEBUG ] ceph-mon: set fsid to 5573b0c6-02fd-4c45-aa89-b88fd08b3b87 [Myhost][DEBUG ] ceph-mon: created monfs at /var/lib/ceph/mon/ceph-myhost for mon.myhost [Myhost][INFO ] unlinking keyring file /var/lib/ceph/tmp/ceph-myhost.mon.keyring [Myhost][DEBUG ] create a done file to avoid re-doing the mon deployment [Myhost][DEBUG ] create the init path if it does not exist [Myhost][DEBUG ] locating the `service` executable... [Myhost][INFO ] Running command: sudo initctl emit ceph-mon cluster=ceph id=myhost [Myhost][INFO ] Running command: sudo ceph --cluster=ceph --admin-daemon /var/run/ceph/ceph-mon.myhost.asok mon_status [Myhost][ERROR ] admin_socket: exception getting command descriptions: [Errno 2] No such file or directory [Myhost][WARNING] monitor: mon.myhost, might not be running yet I checked the monitor log in /var/log/ceph and it does not have anything unusual, just the pid for the ceph-mon process. However, there is no /var/run/ceph/ceph-mon.myhost.asok. I do not know in which step this file is created; hence I am not able to debug this issue. Any pointers wrt this issue would be appreciated. I am using the BLKIN Ceph branch (wip-blkin) i.e. 9.0.1 Ceph packages built from source and my ceph-deploy version is 1.5.28. Thanks, Aakanksha ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
[ceph-users] Cannot create Initial Monitor
Hello Cephers, I am unable to create the initial monitor during ceph cluster deployment. I do not know what changed since the same recipe used to work until very recently. These are the steps I used: Ceph-deploy new -- works Dpkg -i -R --works Ceph-deploy mon create-initial - fails Log: [ceph_deploy.cli][INFO ] Invoked (1.5.28): /usr/bin/ceph-deploy mon create-initial [ceph_deploy.cli][INFO ] ceph-deploy options: [ceph_deploy.cli][INFO ] username : None [ceph_deploy.cli][INFO ] verbose : False [ceph_deploy.cli][INFO ] overwrite_conf: False [ceph_deploy.cli][INFO ] subcommand: create-initial [ceph_deploy.cli][INFO ] quiet : False [ceph_deploy.cli][INFO ] cd_conf : [ceph_deploy.cli][INFO ] cluster : ceph [ceph_deploy.cli][INFO ] func : [ceph_deploy.cli][INFO ] ceph_conf : None [ceph_deploy.cli][INFO ] default_release : False [ceph_deploy.cli][INFO ] keyrings : None [ceph_deploy.mon][DEBUG ] Deploying mon, cluster ceph hosts myhost [ceph_deploy.mon][DEBUG ] detecting platform for host myhost ... [Myhost][DEBUG ] connection detected need for sudo [Myhost][DEBUG ] connected to host: myhost [Myhost][DEBUG ] detect platform information from remote host [Myhost][DEBUG ] detect machine type [Myhost][DEBUG ] find the location of an executable [ceph_deploy.mon][INFO ] distro info: Ubuntu 14.04 trusty [Myhost][DEBUG ] determining if provided host has same hostname in remote [Myhost][DEBUG ] get remote short hostname [Myhost][DEBUG ] deploying mon to myhost [Myhost][DEBUG ] get remote short hostname [Myhost][DEBUG ] remote hostname: myhost [Myhost][DEBUG ] write cluster configuration to /etc/ceph/{cluster}.conf [Myhost][DEBUG ] create the mon path if it does not exist [Myhost][DEBUG ] checking for done path: /var/lib/ceph/mon/ceph-myhost/done [Myhost][DEBUG ] done path does not exist: /var/lib/ceph/mon/ceph-myhost/done [Myhost][INFO ] creating keyring file: /var/lib/ceph/tmp/ceph-myhost.mon.keyring [Myhost][DEBUG ] create the monitor keyring file [Myhost][INFO ] Running command: sudo ceph-mon --cluster ceph --mkfs -i myhost --keyring /var/lib/ceph/tmp/ceph-myhost.mon.keyring [Myhost][DEBUG ] ceph-mon: renaming mon.noname-a xx.xx.xxx.xx:6789/0 to mon.myhost [Myhost][DEBUG ] ceph-mon: set fsid to 5573b0c6-02fd-4c45-aa89-b88fd08b3b87 [Myhost][DEBUG ] ceph-mon: created monfs at /var/lib/ceph/mon/ceph-myhost for mon.myhost [Myhost][INFO ] unlinking keyring file /var/lib/ceph/tmp/ceph-myhost.mon.keyring [Myhost][DEBUG ] create a done file to avoid re-doing the mon deployment [Myhost][DEBUG ] create the init path if it does not exist [Myhost][DEBUG ] locating the `service` executable... [Myhost][INFO ] Running command: sudo initctl emit ceph-mon cluster=ceph id=myhost [Myhost][INFO ] Running command: sudo ceph --cluster=ceph --admin-daemon /var/run/ceph/ceph-mon.myhost.asok mon_status [Myhost][ERROR ] admin_socket: exception getting command descriptions: [Errno 2] No such file or directory [Myhost][WARNING] monitor: mon.myhost, might not be running yet I checked the monitor log in /var/log/ceph and it does not have anything unusual, just the pid for the ceph-mon process. However, there is no /var/run/ceph/ceph-mon.myhost.asok. I do not know in which step this file is created; hence I am not able to debug this issue. Any pointers wrt this issue would be appreciated. I am using the BLKIN Ceph branch (wip-blkin) i.e. 9.0.1 Ceph packages built from source and my ceph-deploy version is 1.5.28. Thanks, Aakanksha ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
Re: [ceph-users] Rados: Undefined symbol error
Hello Brad, Sorry for the delay in replying. As you mentioned earlier, $ `which rados` -v Returns a command not found error $ strings `which rados`|grep "^ceph version" -A5 Returns no results. Thanks a lot! Aakanksha -Original Message- From: Brad Hubbard [mailto:bhubb...@redhat.com] Sent: Thursday, August 27, 2015 10:00 PM To: Aakanksha Pudipeddi-SSI Cc: ceph-us...@ceph.com Subject: Re: [ceph-users] Rados: Undefined symbol error - Original Message - > From: "Brad Hubbard" <bhubb...@redhat.com> > To: "Aakanksha Pudipeddi-SSI" <aakanksha...@ssi.samsung.com> > Cc: ceph-us...@ceph.com > Sent: Friday, 28 August, 2015 10:54:04 AM > Subject: Re: [ceph-users] Rados: Undefined symbol error > > - Original Message - > > From: "Aakanksha Pudipeddi-SSI" <aakanksha...@ssi.samsung.com> > > To: "Brad Hubbard" <bhubb...@redhat.com> > > Cc: "Jason Dillaman" <dilla...@redhat.com>, ceph-us...@ceph.com > > Sent: Friday, 28 August, 2015 6:15:12 AM > > Subject: RE: [ceph-users] Rados: Undefined symbol error > > > > Hello Brad, > > > > Thank you for your response. Looks like the command is undefined. > > > > U _ZN5Mutex4LockEb > > U _ZN5Mutex6UnlockEv > > U _ZN5MutexC1ERKSsbbbP11CephContext > > U _ZN5MutexD1Ev > > $ git checkout v9.0.2 > M src/civetweb > HEAD is now at be422c8... 9.0.2 > > $ git show|head -1 > commit be422c8f5b494c77ebcf0f7b95e5d728ecacb7f0 > > $./autogen.sh && ./configure && make -j2 $ sudo make install > > $ which rados > /usr/local/bin/rados > $ rados -v > ceph version 9.0.2 (be422c8f5b494c77ebcf0f7b95e5d728ecacb7f0) > > $ nm /usr/local/bin/rados|grep ZN5MutexC1ERKSsbbbP11CephContext > 00513790 T _ZN5MutexC1ERKSsbbbP11CephContext > > What OS/environment is this in and is there anything unusual about it > or the build environment or build process? > > What does the following command output? > > $ `which rados` -v Hehe, of course you can't do this because getting it to run is the problem isn't it? :P Try this instead. $ strings `which rados`|grep "^ceph version" -A5 > > > > > Thanks, > > Aakanksha > > > > -Original Message- > > From: Brad Hubbard [mailto:bhubb...@redhat.com] > > Sent: Wednesday, August 26, 2015 5:46 PM > > To: Aakanksha Pudipeddi-SSI > > Cc: Jason Dillaman; ceph-us...@ceph.com > > Subject: Re: [ceph-users] Rados: Undefined symbol error > > > > - Original Message - > > > From: "Aakanksha Pudipeddi-SSI" <aakanksha...@ssi.samsung.com> > > > To: "Jason Dillaman" <dilla...@redhat.com> > > > Cc: ceph-us...@ceph.com > > > Sent: Thursday, 27 August, 2015 6:22:45 AM > > > Subject: Re: [ceph-users] Rados: Undefined symbol error > > > > > > Hello Jason, > > > > > > I checked the version of my built packages and they are all 9.0.2. > > > I purged the cluster and uninstalled the packages and there seems > > > to be nothing else > > > - no older version. Could you elaborate on the fix for this issue? > > > > Some thoughts... > > > > # c++filt _ZN5MutexC1ERKSsbbbP11CephContext > > Mutex::Mutex(std::basic_string<char, std::char_traits, > > std::allocator > const&, bool, bool, bool, CephContext*) > > > > Thats from common/Mutex.cc > > > > # nm --dynamic `which rados` 2>&1|grep Mutex > > 00504da0 T _ZN5Mutex4LockEb > > 00504f70 T _ZN5Mutex6UnlockEv > > 00504a50 T _ZN5MutexC1EPKcbbbP11CephContext > > 000000504a50 T _ZN5MutexC2EPKcbbbP11CephContext > > 00504d10 T _ZN5MutexD1Ev > > 00504d10 T _ZN5MutexD2Ev > > > > This shows my version is defined in the text section of the binary itself. > > What do you get when you run the above command? > > > > Like Jason says this is some sort of mis-match between your rados > > binary and your installed libs. > > > > HTH, > > Brad > > > > > > > > Thanks, > > > Aakanksha > > > > > > -Original Message- > > > From: Jason Dillaman [mailto:dilla...@redhat.com] > > > Sent: Friday, August 21, 2015 6:37 AM > > > To: Aakanksha Pudipeddi-SSI > > > Cc: ceph-us...@ceph.com > > > Subject: Re: [ceph-users] Rados: Undefined symbol error > > > > > > It sounds like you have rados CLI tool from an earlier C
Re: [ceph-users] Rados: Undefined symbol error
Hello Brad, When I type "which rados" it returns /usr/bin/rados. I am using Ubuntu 14.04. I follow these steps in installing ceph from source: 1. ./autogen.sh 2. Going to be using rocksdb, so: ./configure --with-librocksdb-static 3. make 4. sudo dpkg-buildpackage Then I use ceph-deploy to complete setup of the cluster and instead of ceph-deploy install, I type sudo dpkg -i -R . Thanks, Aakanksha -Original Message- From: Brad Hubbard [mailto:bhubb...@redhat.com] Sent: Monday, August 31, 2015 2:19 PM To: Aakanksha Pudipeddi-SSI Cc: ceph-us...@ceph.com Subject: Re: [ceph-users] Rados: Undefined symbol error - Original Message - > From: "Aakanksha Pudipeddi-SSI" <aakanksha...@ssi.samsung.com> > To: "Brad Hubbard" <bhubb...@redhat.com> > Cc: ceph-us...@ceph.com > Sent: Tuesday, 1 September, 2015 3:33:38 AM > Subject: RE: [ceph-users] Rados: Undefined symbol error > > Hello Brad, > > Sorry for the delay in replying. As you mentioned earlier, > > $ `which rados` -v > > Returns a command not found error If it can't find rados how are you using it? Previously I gave you the following command. how did you run it is `whcih rados` returns command not found? # nm --dynamic `which rados` 2>&1|grep Mutex $ which rados Should return the path to the rados binary which you are having problems with. What OS/environment is this in and is there anything unusual about it or the build environment or build process? > > $ strings `which rados`|grep "^ceph version" -A5 > > Returns no results. > > Thanks a lot! > Aakanksha > > -Original Message----- > From: Brad Hubbard [mailto:bhubb...@redhat.com] > Sent: Thursday, August 27, 2015 10:00 PM > To: Aakanksha Pudipeddi-SSI > Cc: ceph-us...@ceph.com > Subject: Re: [ceph-users] Rados: Undefined symbol error > > - Original Message - > > From: "Brad Hubbard" <bhubb...@redhat.com> > > To: "Aakanksha Pudipeddi-SSI" <aakanksha...@ssi.samsung.com> > > Cc: ceph-us...@ceph.com > > Sent: Friday, 28 August, 2015 10:54:04 AM > > Subject: Re: [ceph-users] Rados: Undefined symbol error > > > > - Original Message - > > > From: "Aakanksha Pudipeddi-SSI" <aakanksha...@ssi.samsung.com> > > > To: "Brad Hubbard" <bhubb...@redhat.com> > > > Cc: "Jason Dillaman" <dilla...@redhat.com>, ceph-us...@ceph.com > > > Sent: Friday, 28 August, 2015 6:15:12 AM > > > Subject: RE: [ceph-users] Rados: Undefined symbol error > > > > > > Hello Brad, > > > > > > Thank you for your response. Looks like the command is undefined. > > > > > > U _ZN5Mutex4LockEb > > > U _ZN5Mutex6UnlockEv > > > U _ZN5MutexC1ERKSsbbbP11CephContext > > > U _ZN5MutexD1Ev > > > > $ git checkout v9.0.2 > > M src/civetweb > > HEAD is now at be422c8... 9.0.2 > > > > $ git show|head -1 > > commit be422c8f5b494c77ebcf0f7b95e5d728ecacb7f0 > > > > $./autogen.sh && ./configure && make -j2 $ sudo make install > > > > $ which rados > > /usr/local/bin/rados > > $ rados -v > > ceph version 9.0.2 (be422c8f5b494c77ebcf0f7b95e5d728ecacb7f0) > > > > $ nm /usr/local/bin/rados|grep ZN5MutexC1ERKSsbbbP11CephContext > > 00513790 T _ZN5MutexC1ERKSsbbbP11CephContext > > > > What OS/environment is this in and is there anything unusual about > > it or the build environment or build process? > > > > What does the following command output? > > > > $ `which rados` -v > > Hehe, of course you can't do this because getting it to run is the > problem isn't it? :P > > Try this instead. > > $ strings `which rados`|grep "^ceph version" -A5 > > > > > > > > > Thanks, > > > Aakanksha > > > > > > -Original Message- > > > From: Brad Hubbard [mailto:bhubb...@redhat.com] > > > Sent: Wednesday, August 26, 2015 5:46 PM > > > To: Aakanksha Pudipeddi-SSI > > > Cc: Jason Dillaman; ceph-us...@ceph.com > > > Subject: Re: [ceph-users] Rados: Undefined symbol error > > > > > > - Original Message - > > > > From: "Aakanksha Pudipeddi-SSI" <aakanksha...@ssi.samsung.com> > > > > To: "Jason Dillaman" <dilla...@redhat.com> > > > > Cc: ceph-us...@ceph.com > > > > Sent: Thursday, 27 August, 2015 6:22:45 AM > > > > Subject: Re: [ceph-users] Rados:
Re: [ceph-users] Rados: Undefined symbol error
Brad, Yes, you are right. Sorry about that! This is what I get when I try with the back ticks: $ `which rados` -v /usr/bin/rados: symbol lookup error: /usr/bin/rados: undefined symbol: _ZN5MutexC1ERKSsbbbP11CephContext $ strings `which rados`|grep "^ceph version" $ $ strings $(which rados)|grep "^ceph version" -A5 $ The latest command returns no results too. Thanks, Aakanksha -Original Message- From: Brad Hubbard [mailto:bhubb...@redhat.com] Sent: Monday, August 31, 2015 2:49 PM To: Aakanksha Pudipeddi-SSI Cc: ceph-users Subject: Re: [ceph-users] Rados: Undefined symbol error - Original Message - > From: "Aakanksha Pudipeddi-SSI" <aakanksha...@ssi.samsung.com> > To: "Brad Hubbard" <bhubb...@redhat.com> > Cc: ceph-us...@ceph.com > Sent: Tuesday, 1 September, 2015 7:27:04 AM > Subject: RE: [ceph-users] Rados: Undefined symbol error > > Hello Brad, > > When I type "which rados" it returns /usr/bin/rados. Ah, I think I see what is happening. $ strings `which rados`|grep "^ceph version" -A5 Those are backticks "`", not single quotes "'". Try the following if it's easier. $ strings $(which rados)|grep "^ceph version" -A5 > I am using Ubuntu 14.04. > I follow these steps in installing ceph from source: > > 1. ./autogen.sh > 2. Going to be using rocksdb, so: ./configure --with-librocksdb-static > 3. make 4. sudo dpkg-buildpackage > > Then I use ceph-deploy to complete setup of the cluster and instead of > ceph-deploy install, I type sudo dpkg -i -R result of step 4>. > > Thanks, > Aakanksha > > > -Original Message- > From: Brad Hubbard [mailto:bhubb...@redhat.com] > Sent: Monday, August 31, 2015 2:19 PM > To: Aakanksha Pudipeddi-SSI > Cc: ceph-us...@ceph.com > Subject: Re: [ceph-users] Rados: Undefined symbol error > > - Original Message - > > From: "Aakanksha Pudipeddi-SSI" <aakanksha...@ssi.samsung.com> > > To: "Brad Hubbard" <bhubb...@redhat.com> > > Cc: ceph-us...@ceph.com > > Sent: Tuesday, 1 September, 2015 3:33:38 AM > > Subject: RE: [ceph-users] Rados: Undefined symbol error > > > > Hello Brad, > > > > Sorry for the delay in replying. As you mentioned earlier, > > > > $ `which rados` -v > > > > Returns a command not found error > > If it can't find rados how are you using it? > > Previously I gave you the following command. how did you run it is > `whcih rados` returns command not found? > > # nm --dynamic `which rados` 2>&1|grep Mutex > > $ which rados > > Should return the path to the rados binary which you are having > problems with. > > What OS/environment is this in and is there anything unusual about it > or the build environment or build process? > > > > > $ strings `which rados`|grep "^ceph version" -A5 > > > > Returns no results. > > > > Thanks a lot! > > Aakanksha > > > > -Original Message- > > From: Brad Hubbard [mailto:bhubb...@redhat.com] > > Sent: Thursday, August 27, 2015 10:00 PM > > To: Aakanksha Pudipeddi-SSI > > Cc: ceph-us...@ceph.com > > Subject: Re: [ceph-users] Rados: Undefined symbol error > > > > - Original Message - > > > From: "Brad Hubbard" <bhubb...@redhat.com> > > > To: "Aakanksha Pudipeddi-SSI" <aakanksha...@ssi.samsung.com> > > > Cc: ceph-us...@ceph.com > > > Sent: Friday, 28 August, 2015 10:54:04 AM > > > Subject: Re: [ceph-users] Rados: Undefined symbol error > > > > > > - Original Message - > > > > From: "Aakanksha Pudipeddi-SSI" <aakanksha...@ssi.samsung.com> > > > > To: "Brad Hubbard" <bhubb...@redhat.com> > > > > Cc: "Jason Dillaman" <dilla...@redhat.com>, ceph-us...@ceph.com > > > > Sent: Friday, 28 August, 2015 6:15:12 AM > > > > Subject: RE: [ceph-users] Rados: Undefined symbol error > > > > > > > > Hello Brad, > > > > > > > > Thank you for your response. Looks like the command is undefined. > > > > > > > > U _ZN5Mutex4LockEb > > > > U _ZN5Mutex6UnlockEv > > > > U _ZN5MutexC1ERKSsbbbP11CephContext > > > > U _ZN5MutexD1Ev > > > > > > $ git checkout v9.0.2 > > > M src/civetweb > > > HEAD is now at be422c8... 9.0.2 > > > > > > $ git show|head -1 > > > commit be422c
Re: [ceph-users] Rados: Undefined symbol error
Hello Brad, Thank you for your response. Looks like the command is undefined. U _ZN5Mutex4LockEb U _ZN5Mutex6UnlockEv U _ZN5MutexC1ERKSsbbbP11CephContext U _ZN5MutexD1Ev Thanks, Aakanksha -Original Message- From: Brad Hubbard [mailto:bhubb...@redhat.com] Sent: Wednesday, August 26, 2015 5:46 PM To: Aakanksha Pudipeddi-SSI Cc: Jason Dillaman; ceph-us...@ceph.com Subject: Re: [ceph-users] Rados: Undefined symbol error - Original Message - From: Aakanksha Pudipeddi-SSI aakanksha...@ssi.samsung.com To: Jason Dillaman dilla...@redhat.com Cc: ceph-us...@ceph.com Sent: Thursday, 27 August, 2015 6:22:45 AM Subject: Re: [ceph-users] Rados: Undefined symbol error Hello Jason, I checked the version of my built packages and they are all 9.0.2. I purged the cluster and uninstalled the packages and there seems to be nothing else - no older version. Could you elaborate on the fix for this issue? Some thoughts... # c++filt _ZN5MutexC1ERKSsbbbP11CephContext Mutex::Mutex(std::basic_stringchar, std::char_traitschar, std::allocatorchar const, bool, bool, bool, CephContext*) Thats from common/Mutex.cc # nm --dynamic `which rados` 21|grep Mutex 00504da0 T _ZN5Mutex4LockEb 00504f70 T _ZN5Mutex6UnlockEv 00504a50 T _ZN5MutexC1EPKcbbbP11CephContext 00504a50 T _ZN5MutexC2EPKcbbbP11CephContext 00504d10 T _ZN5MutexD1Ev 00504d10 T _ZN5MutexD2Ev This shows my version is defined in the text section of the binary itself. What do you get when you run the above command? Like Jason says this is some sort of mis-match between your rados binary and your installed libs. HTH, Brad Thanks, Aakanksha -Original Message- From: Jason Dillaman [mailto:dilla...@redhat.com] Sent: Friday, August 21, 2015 6:37 AM To: Aakanksha Pudipeddi-SSI Cc: ceph-us...@ceph.com Subject: Re: [ceph-users] Rados: Undefined symbol error It sounds like you have rados CLI tool from an earlier Ceph release ( Hammer) installed and it is attempting to use the librados shared library from a newer (= Hammer) version of Ceph. Jason - Original Message - From: Aakanksha Pudipeddi-SSI aakanksha...@ssi.samsung.com To: ceph-us...@ceph.com Sent: Thursday, August 20, 2015 11:47:26 PM Subject: [ceph-users] Rados: Undefined symbol error Hello, I cloned the master branch of Ceph and after setting up the cluster, when I tried to use the rados commands, I got this error: rados: symbol lookup error: rados: undefined symbol: _ZN5MutexC1ERKSsbbbP11CephContext I saw a similar post here: http://tracker.ceph.com/issues/12563 but I am not clear on the solution for this problem. I am not performing an upgrade here but the error seems to be similar. Could anybody shed more light on the issue and how to solve it? Thanks a lot! Aakanksha ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
Re: [ceph-users] Rados: Undefined symbol error
Hello Jason, I checked the version of my built packages and they are all 9.0.2. I purged the cluster and uninstalled the packages and there seems to be nothing else - no older version. Could you elaborate on the fix for this issue? Thanks, Aakanksha -Original Message- From: Jason Dillaman [mailto:dilla...@redhat.com] Sent: Friday, August 21, 2015 6:37 AM To: Aakanksha Pudipeddi-SSI Cc: ceph-us...@ceph.com Subject: Re: [ceph-users] Rados: Undefined symbol error It sounds like you have rados CLI tool from an earlier Ceph release ( Hammer) installed and it is attempting to use the librados shared library from a newer (= Hammer) version of Ceph. Jason - Original Message - From: Aakanksha Pudipeddi-SSI aakanksha...@ssi.samsung.com To: ceph-us...@ceph.com Sent: Thursday, August 20, 2015 11:47:26 PM Subject: [ceph-users] Rados: Undefined symbol error Hello, I cloned the master branch of Ceph and after setting up the cluster, when I tried to use the rados commands, I got this error: rados: symbol lookup error: rados: undefined symbol: _ZN5MutexC1ERKSsbbbP11CephContext I saw a similar post here: http://tracker.ceph.com/issues/12563 but I am not clear on the solution for this problem. I am not performing an upgrade here but the error seems to be similar. Could anybody shed more light on the issue and how to solve it? Thanks a lot! Aakanksha ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
[ceph-users] Rados: Undefined symbol error
Hello, I cloned the master branch of Ceph and after setting up the cluster, when I tried to use the rados commands, I got this error: rados: symbol lookup error: rados: undefined symbol: _ZN5MutexC1ERKSsbbbP11CephContext I saw a similar post here: http://tracker.ceph.com/issues/12563 but I am not clear on the solution for this problem. I am not performing an upgrade here but the error seems to be similar. Could anybody shed more light on the issue and how to solve it? Thanks a lot! Aakanksha ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
Re: [ceph-users] Error while trying to create Ceph block device
Hello Somnath, Thanks for the quick response! I checked the versions on the client and the cluster machine. They actually had different versions of ceph installed: 0.94.2 on the cluster and 0.80.9 on the client. I made changes so that both of them have the same version of Ceph now. As for the librbd, librados packages, they seem to be having the same packages: librbd-dev, librbd1, librados2 and a few others. Is there any other way I could cross check? Thanks, Aakanksha From: Somnath Roy [mailto:somnath@sandisk.com] Sent: Tuesday, August 04, 2015 5:21 PM To: Aakanksha Pudipeddi-SSI; ceph-us...@ceph.com Subject: RE: Error while trying to create Ceph block device There is probably a binary version mismatch (?)...Make sure rbd command is loading the proper librbd/librados binaries... Thanks Regards Somnath From: ceph-users [mailto:ceph-users-boun...@lists.ceph.com] On Behalf Of Aakanksha Pudipeddi-SSI Sent: Tuesday, August 04, 2015 5:06 PM To: ceph-us...@ceph.commailto:ceph-us...@ceph.com Subject: [ceph-users] Error while trying to create Ceph block device Hi, I am trying to create a Ceph block device on a ceph cluster machine itself for experimental purposes. I used to be able to do that earlier but it gives me a segmentation fault right now: *** Caught signal (Segmentation fault) ** in thread 7f49628f6840 ceph version 0.94.2 (5fb85614ca8f354284c713a2f9c610860720bbf3) 1: rbd() [0x595ffa] 2: (()+0x10340) [0x7f495cffc340] 3: (std::string::compare(char const*) const+0x1e) [0x7f495c21a17e] 4: (()+0x2d11e2) [0x7f495d6f11e2] 5: (()+0xa6c16) [0x7f495d4c6c16] 6: (main()+0x2952) [0x4c1132] 7: (__libc_start_main()+0xf5) [0x7f495b89fec5] 8: rbd() [0x4c6ee7] 2015-08-04 16:53:49.656920 7f49628f6840 -1 *** Caught signal (Segmentation fault) ** in thread 7f49628f6840 --- begin dump of recent events --- -15 2015-08-04 17:00:00.719905 7fce88413840 5 asok(0x327ed80) register_command perfcounters_dump hook 0x3280ef0 -14 2015-08-04 17:00:00.719922 7fce88413840 5 asok(0x327ed80) register_command 1 hook 0x3280ef0 -13 2015-08-04 17:00:00.719925 7fce88413840 5 asok(0x327ed80) register_command perf dump hook 0x3280ef0 -12 2015-08-04 17:00:00.719928 7fce88413840 5 asok(0x327ed80) register_command perfcounters_schema hook 0x3280ef0 -11 2015-08-04 17:00:00.719931 7fce88413840 5 asok(0x327ed80) register_command 2 hook 0x3280ef0 -10 2015-08-04 17:00:00.719932 7fce88413840 5 asok(0x327ed80) register_command perf schema hook 0x3280ef0 -9 2015-08-04 17:00:00.719938 7fce88413840 5 asok(0x327ed80) register_command perf reset hook 0x3280ef0 -8 2015-08-04 17:00:00.719941 7fce88413840 5 asok(0x327ed80) register_command config show hook 0x3280ef0 -7 2015-08-04 17:00:00.719942 7fce88413840 5 asok(0x327ed80) register_command config set hook 0x3280ef0 -6 2015-08-04 17:00:00.719946 7fce88413840 5 asok(0x327ed80) register_command config get hook 0x3280ef0 -5 2015-08-04 17:00:00.719947 7fce88413840 5 asok(0x327ed80) register_command config diff hook 0x3280ef0 -4 2015-08-04 17:00:00.719950 7fce88413840 5 asok(0x327ed80) register_command log flush hook 0x3280ef0 -3 2015-08-04 17:00:00.719951 7fce88413840 5 asok(0x327ed80) register_command log dump hook 0x3280ef0 -2 2015-08-04 17:00:00.719954 7fce88413840 5 asok(0x327ed80) register_command log reopen hook 0x3280ef0 -1 2015-08-04 17:00:00.722884 7fce88413840 10 monclient(hunting): build_initial_monmap 0 2015-08-04 17:00:00.723176 7fce88413840 -1 *** Caught signal (Segmentation fault) ** in thread 7fce88413840 Could anybody help me out here? I have no issues creating an image on a separate client machine. Thanks, Aakanksha PLEASE NOTE: The information contained in this electronic mail message is intended only for the use of the designated recipient(s) named above. If the reader of this message is not the intended recipient, you are hereby notified that you have received this message in error and that any review, dissemination, distribution, or copying of this message is strictly prohibited. If you have received this communication in error, please notify the sender by telephone or e-mail (as shown above) immediately and destroy any and all copies of this message in your possession (whether hard copies or electronically stored copies). ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
Re: [ceph-users] Error while trying to create Ceph block device
Hello Somnath, I tried that and it seems to be loading librados.so.2.0.0 in both cases (client and cluster machine). Thanks, Aakanksha From: Somnath Roy [mailto:somnath@sandisk.com] Sent: Tuesday, August 04, 2015 6:00 PM To: Aakanksha Pudipeddi-SSI; ceph-us...@ceph.com Subject: RE: Error while trying to create Ceph block device Just make sure with tool like 'lsof' or so that ceph commands are loading the proper librados/librbd binaries by running say 'ceph -w'... It should be loading hammer version of librbd/librados.. From: Aakanksha Pudipeddi-SSI [mailto:aakanksha...@ssi.samsung.com] Sent: Tuesday, August 04, 2015 5:56 PM To: Somnath Roy; ceph-us...@ceph.commailto:ceph-us...@ceph.com Subject: RE: Error while trying to create Ceph block device Hello Somnath, Thanks for the quick response! I checked the versions on the client and the cluster machine. They actually had different versions of ceph installed: 0.94.2 on the cluster and 0.80.9 on the client. I made changes so that both of them have the same version of Ceph now. As for the librbd, librados packages, they seem to be having the same packages: librbd-dev, librbd1, librados2 and a few others. Is there any other way I could cross check? Thanks, Aakanksha From: Somnath Roy [mailto:somnath@sandisk.com] Sent: Tuesday, August 04, 2015 5:21 PM To: Aakanksha Pudipeddi-SSI; ceph-us...@ceph.commailto:ceph-us...@ceph.com Subject: RE: Error while trying to create Ceph block device There is probably a binary version mismatch (?)...Make sure rbd command is loading the proper librbd/librados binaries... Thanks Regards Somnath From: ceph-users [mailto:ceph-users-boun...@lists.ceph.com] On Behalf Of Aakanksha Pudipeddi-SSI Sent: Tuesday, August 04, 2015 5:06 PM To: ceph-us...@ceph.commailto:ceph-us...@ceph.com Subject: [ceph-users] Error while trying to create Ceph block device Hi, I am trying to create a Ceph block device on a ceph cluster machine itself for experimental purposes. I used to be able to do that earlier but it gives me a segmentation fault right now: *** Caught signal (Segmentation fault) ** in thread 7f49628f6840 ceph version 0.94.2 (5fb85614ca8f354284c713a2f9c610860720bbf3) 1: rbd() [0x595ffa] 2: (()+0x10340) [0x7f495cffc340] 3: (std::string::compare(char const*) const+0x1e) [0x7f495c21a17e] 4: (()+0x2d11e2) [0x7f495d6f11e2] 5: (()+0xa6c16) [0x7f495d4c6c16] 6: (main()+0x2952) [0x4c1132] 7: (__libc_start_main()+0xf5) [0x7f495b89fec5] 8: rbd() [0x4c6ee7] 2015-08-04 16:53:49.656920 7f49628f6840 -1 *** Caught signal (Segmentation fault) ** in thread 7f49628f6840 --- begin dump of recent events --- -15 2015-08-04 17:00:00.719905 7fce88413840 5 asok(0x327ed80) register_command perfcounters_dump hook 0x3280ef0 -14 2015-08-04 17:00:00.719922 7fce88413840 5 asok(0x327ed80) register_command 1 hook 0x3280ef0 -13 2015-08-04 17:00:00.719925 7fce88413840 5 asok(0x327ed80) register_command perf dump hook 0x3280ef0 -12 2015-08-04 17:00:00.719928 7fce88413840 5 asok(0x327ed80) register_command perfcounters_schema hook 0x3280ef0 -11 2015-08-04 17:00:00.719931 7fce88413840 5 asok(0x327ed80) register_command 2 hook 0x3280ef0 -10 2015-08-04 17:00:00.719932 7fce88413840 5 asok(0x327ed80) register_command perf schema hook 0x3280ef0 -9 2015-08-04 17:00:00.719938 7fce88413840 5 asok(0x327ed80) register_command perf reset hook 0x3280ef0 -8 2015-08-04 17:00:00.719941 7fce88413840 5 asok(0x327ed80) register_command config show hook 0x3280ef0 -7 2015-08-04 17:00:00.719942 7fce88413840 5 asok(0x327ed80) register_command config set hook 0x3280ef0 -6 2015-08-04 17:00:00.719946 7fce88413840 5 asok(0x327ed80) register_command config get hook 0x3280ef0 -5 2015-08-04 17:00:00.719947 7fce88413840 5 asok(0x327ed80) register_command config diff hook 0x3280ef0 -4 2015-08-04 17:00:00.719950 7fce88413840 5 asok(0x327ed80) register_command log flush hook 0x3280ef0 -3 2015-08-04 17:00:00.719951 7fce88413840 5 asok(0x327ed80) register_command log dump hook 0x3280ef0 -2 2015-08-04 17:00:00.719954 7fce88413840 5 asok(0x327ed80) register_command log reopen hook 0x3280ef0 -1 2015-08-04 17:00:00.722884 7fce88413840 10 monclient(hunting): build_initial_monmap 0 2015-08-04 17:00:00.723176 7fce88413840 -1 *** Caught signal (Segmentation fault) ** in thread 7fce88413840 Could anybody help me out here? I have no issues creating an image on a separate client machine. Thanks, Aakanksha PLEASE NOTE: The information contained in this electronic mail message is intended only for the use of the designated recipient(s) named above. If the reader of this message is not the intended recipient, you are hereby notified that you have received this message in error and that any review, dissemination, distribution, or copying of this message is strictly prohibited. If you have received this communication in error, please notify the sender
[ceph-users] Error while trying to create Ceph block device
Hi, I am trying to create a Ceph block device on a ceph cluster machine itself for experimental purposes. I used to be able to do that earlier but it gives me a segmentation fault right now: *** Caught signal (Segmentation fault) ** in thread 7f49628f6840 ceph version 0.94.2 (5fb85614ca8f354284c713a2f9c610860720bbf3) 1: rbd() [0x595ffa] 2: (()+0x10340) [0x7f495cffc340] 3: (std::string::compare(char const*) const+0x1e) [0x7f495c21a17e] 4: (()+0x2d11e2) [0x7f495d6f11e2] 5: (()+0xa6c16) [0x7f495d4c6c16] 6: (main()+0x2952) [0x4c1132] 7: (__libc_start_main()+0xf5) [0x7f495b89fec5] 8: rbd() [0x4c6ee7] 2015-08-04 16:53:49.656920 7f49628f6840 -1 *** Caught signal (Segmentation fault) ** in thread 7f49628f6840 --- begin dump of recent events --- -15 2015-08-04 17:00:00.719905 7fce88413840 5 asok(0x327ed80) register_command perfcounters_dump hook 0x3280ef0 -14 2015-08-04 17:00:00.719922 7fce88413840 5 asok(0x327ed80) register_command 1 hook 0x3280ef0 -13 2015-08-04 17:00:00.719925 7fce88413840 5 asok(0x327ed80) register_command perf dump hook 0x3280ef0 -12 2015-08-04 17:00:00.719928 7fce88413840 5 asok(0x327ed80) register_command perfcounters_schema hook 0x3280ef0 -11 2015-08-04 17:00:00.719931 7fce88413840 5 asok(0x327ed80) register_command 2 hook 0x3280ef0 -10 2015-08-04 17:00:00.719932 7fce88413840 5 asok(0x327ed80) register_command perf schema hook 0x3280ef0 -9 2015-08-04 17:00:00.719938 7fce88413840 5 asok(0x327ed80) register_command perf reset hook 0x3280ef0 -8 2015-08-04 17:00:00.719941 7fce88413840 5 asok(0x327ed80) register_command config show hook 0x3280ef0 -7 2015-08-04 17:00:00.719942 7fce88413840 5 asok(0x327ed80) register_command config set hook 0x3280ef0 -6 2015-08-04 17:00:00.719946 7fce88413840 5 asok(0x327ed80) register_command config get hook 0x3280ef0 -5 2015-08-04 17:00:00.719947 7fce88413840 5 asok(0x327ed80) register_command config diff hook 0x3280ef0 -4 2015-08-04 17:00:00.719950 7fce88413840 5 asok(0x327ed80) register_command log flush hook 0x3280ef0 -3 2015-08-04 17:00:00.719951 7fce88413840 5 asok(0x327ed80) register_command log dump hook 0x3280ef0 -2 2015-08-04 17:00:00.719954 7fce88413840 5 asok(0x327ed80) register_command log reopen hook 0x3280ef0 -1 2015-08-04 17:00:00.722884 7fce88413840 10 monclient(hunting): build_initial_monmap 0 2015-08-04 17:00:00.723176 7fce88413840 -1 *** Caught signal (Segmentation fault) ** in thread 7fce88413840 Could anybody help me out here? I have no issues creating an image on a separate client machine. Thanks, Aakanksha ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
Re: [ceph-users] Configuring MemStore in Ceph
Hello Haomai, Thanks for your response. Yes, I cannot write more than 1GB of data to it. I am using the latest version deployed by ceph-deploy so I am assuming the fix must be a part of it. Also, while creating osds using ceph-deploy, I just use a local directory such as /var/local/osd0. Is there any particular step to change while creating the osd with memstore? Thanks a lot for your help! Aakanksha -Original Message- From: Haomai Wang [mailto:haomaiw...@gmail.com] Sent: Tuesday, July 28, 2015 7:36 PM To: Aakanksha Pudipeddi-SSI Cc: ceph-us...@ceph.com Subject: Re: [ceph-users] Configuring MemStore in Ceph On Wed, Jul 29, 2015 at 10:21 AM, Aakanksha Pudipeddi-SSI aakanksha...@ssi.samsung.com wrote: Hello Haomai, I am using v0.94.2. Thanks, Aakanksha -Original Message- From: Haomai Wang [mailto:haomaiw...@gmail.com] Sent: Tuesday, July 28, 2015 7:20 PM To: Aakanksha Pudipeddi-SSI Cc: ceph-us...@ceph.com Subject: Re: [ceph-users] Configuring MemStore in Ceph Which version do you use? https://github.com/ceph/ceph/commit/c60f88ba8a6624099f576eaa5f1225c2fc aab41a should fix your problem On Wed, Jul 29, 2015 at 5:44 AM, Aakanksha Pudipeddi-SSI aakanksha...@ssi.samsung.com wrote: Hello, I am trying to setup a ceph cluster with a memstore backend. The problem is, it is always created with a fixed size (1GB). I made changes to the ceph.conf file as follows: osd_objectstore = memstore memstore_device_bytes = 5*1024*1024*1024 The resultant cluster still has 1GB allocated to it. Could anybody point out what I am doing wrong here? What's the mean of The resultant cluster still has 1GB allocated to it? Is it mean that you can't write data more than 1GB? Thanks, Aakanksha ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com -- Best Regards, Wheat -- Best Regards, Wheat ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
Re: [ceph-users] Configuring MemStore in Ceph
Hello Haomai, The issue was with me not mentioning the value correctly in ceph.conf. I mistakenly used 5*1024*1024*1024 instead of the value 5368709120. Thanks for your help! :) Aakanksha -Original Message- From: Haomai Wang [mailto:haomaiw...@gmail.com] Sent: Wednesday, July 29, 2015 10:15 AM To: Aakanksha Pudipeddi-SSI Cc: ceph-us...@ceph.com Subject: Re: [ceph-users] Configuring MemStore in Ceph On Thu, Jul 30, 2015 at 1:09 AM, Aakanksha Pudipeddi-SSI aakanksha...@ssi.samsung.com wrote: Hello Haomai, Thanks for your response. Yes, I cannot write more than 1GB of data to it. I am using the latest version deployed by ceph-deploy so I am assuming the fix must be a part of it. Also, while creating osds using ceph-deploy, I just use a local directory such as /var/local/osd0. Is there any particular step to change while creating the osd with memstore? Thanks a lot for your help! Hmm, I can't think of other ideas. Maybe you could verify your osd config value via ceph daemon osd.0 config show | grep memstore Aakanksha -Original Message- From: Haomai Wang [mailto:haomaiw...@gmail.com] Sent: Tuesday, July 28, 2015 7:36 PM To: Aakanksha Pudipeddi-SSI Cc: ceph-us...@ceph.com Subject: Re: [ceph-users] Configuring MemStore in Ceph On Wed, Jul 29, 2015 at 10:21 AM, Aakanksha Pudipeddi-SSI aakanksha...@ssi.samsung.com wrote: Hello Haomai, I am using v0.94.2. Thanks, Aakanksha -Original Message- From: Haomai Wang [mailto:haomaiw...@gmail.com] Sent: Tuesday, July 28, 2015 7:20 PM To: Aakanksha Pudipeddi-SSI Cc: ceph-us...@ceph.com Subject: Re: [ceph-users] Configuring MemStore in Ceph Which version do you use? https://github.com/ceph/ceph/commit/c60f88ba8a6624099f576eaa5f1225c2f c aab41a should fix your problem On Wed, Jul 29, 2015 at 5:44 AM, Aakanksha Pudipeddi-SSI aakanksha...@ssi.samsung.com wrote: Hello, I am trying to setup a ceph cluster with a memstore backend. The problem is, it is always created with a fixed size (1GB). I made changes to the ceph.conf file as follows: osd_objectstore = memstore memstore_device_bytes = 5*1024*1024*1024 The resultant cluster still has 1GB allocated to it. Could anybody point out what I am doing wrong here? What's the mean of The resultant cluster still has 1GB allocated to it? Is it mean that you can't write data more than 1GB? Thanks, Aakanksha ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com -- Best Regards, Wheat -- Best Regards, Wheat -- Best Regards, Wheat ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
Re: [ceph-users] Configuring MemStore in Ceph
Hello Haomai, I am using v0.94.2. Thanks, Aakanksha -Original Message- From: Haomai Wang [mailto:haomaiw...@gmail.com] Sent: Tuesday, July 28, 2015 7:20 PM To: Aakanksha Pudipeddi-SSI Cc: ceph-us...@ceph.com Subject: Re: [ceph-users] Configuring MemStore in Ceph Which version do you use? https://github.com/ceph/ceph/commit/c60f88ba8a6624099f576eaa5f1225c2fcaab41a should fix your problem On Wed, Jul 29, 2015 at 5:44 AM, Aakanksha Pudipeddi-SSI aakanksha...@ssi.samsung.com wrote: Hello, I am trying to setup a ceph cluster with a memstore backend. The problem is, it is always created with a fixed size (1GB). I made changes to the ceph.conf file as follows: osd_objectstore = memstore memstore_device_bytes = 5*1024*1024*1024 The resultant cluster still has 1GB allocated to it. Could anybody point out what I am doing wrong here? Thanks, Aakanksha ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com -- Best Regards, Wheat ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
[ceph-users] Configuring MemStore in Ceph
Hello, I am trying to setup a ceph cluster with a memstore backend. The problem is, it is always created with a fixed size (1GB). I made changes to the ceph.conf file as follows: osd_objectstore = memstore memstore_device_bytes = 5*1024*1024*1024 The resultant cluster still has 1GB allocated to it. Could anybody point out what I am doing wrong here? Thanks, Aakanksha ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
[ceph-users] Error while installing ceph built from source
Hello, I am trying to deploy a ceph cluster by compile from sources and I get an error with these messages: dpkg: dependency problems prevent configuration of ceph: ceph depends on ceph-common (= 9.0.0-943); however: Version of ceph-common on system is 9.0.0-1. ceph-common (9.0.0-1) breaks ceph ( 9.0.0-943) and is unpacked but not configured. Version of ceph to be configured is 9.0.0-1. . . . . Errors were encountered while processing: ceph ceph-dbg ceph-mds ceph-mds-dbg ceph-resource-agents I followed the steps from the documentation to build Ceph packages from source: 1. ./autogen.sh 2. ./configure 3. make -j6 4. sudo dpkg-buildpackage Now I am trying to deploy using the same procedure mentioned in ceph-deploy (with the exception of the ceph-deploy install ceph step): 1. ceph-deploy new hostname 2. sudo dpkg -i * (in the folder containing the .deb files) At this step I get the error that is pasted above. I was able to follow the same procedure without any issues on 2 other machines but I am not able to identify the root cause. Any help from the community is appreciated! Thanks, Aakanksha ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
[ceph-users] Problem deploying a ceph cluster built from source
Hello all, I am attempting to install a ceph cluster which has been built from source. I first cloned the Ceph master repository and then followed steps given in the Ceph documentation about installing a Ceph build. So I now have the binaries available in /usr/local/bin. The next step is for me to deploy this build and I used ceph-deploy to do that: $ceph-deploy install -dev=master hostname This is where I get this error: [ceph_deploy.conf][DEBUG ] found configuration file at: /home/ssd/.cephdeploy.conf [ceph_deploy.cli][INFO ] Invoked (1.5.23): /usr/bin/ceph-deploy install --dev=master Hostname [ceph_deploy.install][DEBUG ] Installing dev version master on cluster ceph hosts Hostname [ceph_deploy.install][DEBUG ] Detecting platform for host Hostname ... [Hostname][DEBUG ] connection detected need for sudo [Hostname][DEBUG ] connected to host: Hostname [Hostname][DEBUG ] detect platform information from remote host [Hostname][DEBUG ] detect machine type [ceph_deploy.install][INFO ] Distro info: Ubuntu 14.04 trusty [Hostname][INFO ] installing ceph on Hostname [Hostname][INFO ] Running command: sudo env DEBIAN_FRONTEND=noninteractive apt-get -q install --assume-yes ca-certificates [Hostname][DEBUG ] Reading package lists... [Hostname][DEBUG ] Building dependency tree... [Hostname][DEBUG ] Reading state information... [Hostname][DEBUG ] ca-certificates is already the newest version. [Hostname][DEBUG ] The following packages were automatically installed and are no longer required: [Hostname][DEBUG ] libcephfs1 librados2 librbd1 python-ceph python-flask python-itsdangerous [Hostname][DEBUG ] python-werkzeug [Hostname][DEBUG ] Use 'apt-get autoremove' to remove them. [Hostname][DEBUG ] 0 upgraded, 0 newly installed, 0 to remove and 389 not upgraded. [Hostname][INFO ] Running command: sudo wget -O autobuild.asc https://ceph.com/git/?p=ceph.git;a=blob_plain;f=keys/autobuild.asc [Hostname][WARNIN] --2015-05-18 15:39:01-- https://ceph.com/git/?p=ceph.git;a=blob_plain;f=keys/autobuild.asc [Hostname][WARNIN] Resolving ceph.com (ceph.com)... [Hostname][WARNIN] Connecting to ceph.com (ceph.com) ... connected. [Hostname][WARNIN] ERROR: cannot verify ceph.com's certificate, issued by ... [Hostname][WARNIN] Unable to locally verify the issuer's authority. [Hostname][WARNIN] To connect to ceph.com insecurely, use `--no-check-certificate'. [Hostname][WARNIN] command returned non-zero exit status: 5 [Hostname][INFO ] Running command: sudo apt-key add autobuild.asc [Hostname][WARNIN] gpg: no valid OpenPGP data found. [Hostname][ERROR ] RuntimeError: command returned non-zero exit status: 2 [ceph_deploy][ERROR ] RuntimeError: Failed to execute command: apt-key add autobuild.asc I have checked with ssl certfificates and ca-certificates and they are the newest version. I have deployed a cluster with ceph-deploy earlier using the Quick installation guide and I got this certificate error then as well. But I used the -no-check-certificate flag then and it worked well. While using the ceph-deploy install command during the quick installation process, I used -no-adjust-repos and the same certificate verify error disappeared. But the same flag does not work here as ceph-deploy install -dev and -no-adjust-repos do not go together. I have two questions: 1. Is this the right way to deploy a ceph cluster built from source? I am asking since it is not mentioned directly as an end-to-end document as to how to deploy a ceph cluster which has been built from source 2. In cases where the ceph certificate is unverified, is it possible to issue something equivalent of the -no-check-certificate flag so that the installation does not stop because of an unverified certificate? Thanks! Aakanksha ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com