[ceph-users] how to install radosgw from source code?

2013-09-23 Thread yy-nm
hay, folks: i use ceph source code to install a ceph cluster. ceph version 0.61.8 (a6fdcca3bddbc9f177e4e2bf0d9cdd85006b028b) After finish install, i can't find radosgw command? i use below paramter in ceph's installation: install package: |#apt-get install automake autoconf gcc g++

Re: [ceph-users] one pg stuck with 2 unfound pieces

2013-09-23 Thread Jens-Christian Fischer
Hi Sam in the meantime, the output of ceph pg 0.cfa query has become quite a bit longer (for better or worse) - see: http://pastebin.com/0Jxmm353 I have restarted osd.23 with the debug log settings and have extracted these 0.cfa related log lines - I can't interpret them. There might be more,

[ceph-users] where to put config and whats the correct syntax

2013-09-23 Thread Fuchs, Andreas (SwissTXT)
I'm following different threads here, mainly the poor radosgw performance one. And what I see there are often recommendation to put a certain config to ceph.conf, but often it's unclear to me where exactly to put them - does it matter if I put a config for all OSD's in [global] or [osd] ?

Re: [ceph-users] monitor deployment during quick start

2013-09-23 Thread Alfredo Deza
On Fri, Sep 20, 2013 at 3:58 PM, Gruher, Joseph R joseph.r.gru...@intel.com wrote: Sorry, not trying to repost or bump my thread, but I think I can restate my question here and for better clarity. I am confused about the --cluster argument used when ceph-deploy mon create invokes ceph-mon on

[ceph-users] Question about Ceph performance

2013-09-23 Thread Dafan Dong
Hi folks, I am Dafan from Yahoo! corp. We are really interested in Ceph now. I wish to know where I can get some performance report about new released DUMPLING? Like throughput, latency with different cluster scale and hardware type? Thanks. Dafan

[ceph-users] clients in cluster network?

2013-09-23 Thread Kurt Bauer
Hi, just a short question to which I couldn't find an answer in the documentation: When I run a cluster with public and cluster network seperated, would it still be possible to have clients accessing the cluster (ie. RBDs) from within the cluster network? Thanks for your help, best regards, Kurt

[ceph-users] ceph-deploy again

2013-09-23 Thread Bernhard Glomm
Hi all, something with ceph-deploy doesen't work at all anymore. After an upgrade ceph-depoly failed to roll out a new monitor with permission denied. are you root? (obviously there shouldn't be a root login so I had another user for ceph-deploy before which worked perfectly, why not now?)

Re: [ceph-users] Hadoop and Ceph integration issues

2013-09-23 Thread Noah Watkins
property nameceph.root.dir/name value/mnt/mycephfs/value /property This is probably causing the issue. Is this meant to be a local mount point? The 'ceph.root.dir' property specifies the root directory /inside/ CephFS, and the Hadoop implementation doesn't require a local

Re: [ceph-users] clients in cluster network?

2013-09-23 Thread John Wilkins
Clients use the public network. The cluster network is principally for OSD-to-OSD communication--heartbeats, replication, backfill, etc. On Mon, Sep 23, 2013 at 7:42 AM, Kurt Bauer kurt.ba...@univie.ac.at wrote: Hi, just a short question to which I couldn't find an answer in the

Re: [ceph-users] Hadoop and Ceph integration issues

2013-09-23 Thread Noah Watkins
Shoot, I thought I had it figured out :) There is a default admin user created when you first create your cluster. After a typical install via ceph-deploy, there should be a file called 'ceph.client.admin.keyring', usually sibling to ceph.conf. If this is in a standard location (e.g. /etc/ceph)

Re: [ceph-users] Hadoop and Ceph integration issues

2013-09-23 Thread Rolando Martins
Hi Noah, updated the core-site.xml (bellow). All the nodes have the same files. But the problem remains the same. What is the value for ceph.auth.keyring? Is the path containing the file ceph.mon.keyring? Thanks, Rolando P.S.: I have the cephFS mounted locally, so the cluster is ok. cluster

Re: [ceph-users] Hadoop and Ceph integration issues

2013-09-23 Thread Rolando Martins
Hi Noah, I enabled the debugging and got: 2013-09-23 18:59:34.705894 7f0b58de7700 -1 monclient(hunting): ERROR: missing keyring, cannot use cephx for authentication 2013-09-23 18:59:34.706106 7f0b58de7700 20 client.-1 trim_cache size 0 max 0 2013-09-23 18:59:34.706225 7f0b58de7700 10 jni:

Re: [ceph-users] monitor deployment during quick start

2013-09-23 Thread Sage Weil
On Mon, 23 Sep 2013, Alfredo Deza wrote: On Fri, Sep 20, 2013 at 3:58 PM, Gruher, Joseph R joseph.r.gru...@intel.com wrote: Sorry, not trying to repost or bump my thread, but I think I can restate my question here and for better clarity. I am confused about the --cluster argument used

Re: [ceph-users] how to install radosgw from source code?

2013-09-23 Thread Somnath Roy
I think some dependency is missing.. For example, I can see the libcurl package is missing..See the build prerequisite. http://ceph.com/docs/next/install/build-prerequisites/ The configure/autogen script is checking the packages installed in your system and accordingly creating the makefiles.

Re: [ceph-users] Hadoop and Ceph integration issues

2013-09-23 Thread Noah Watkins
What happens when you run `bin/hadoop fs -ls` ? This is entirely local, and a bit simpler and easier to grok. On Mon, Sep 23, 2013 at 12:23 PM, Rolando Martins rolando.mart...@gmail.com wrote: I am trying to start hadoop using bin/start-mapred.sh. In the HADOOP_HOME/lib, I have:

Re: [ceph-users] Hadoop and Ceph integration issues

2013-09-23 Thread Noah Watkins
In the log file that you showing, do you see where the keyring file is being set by Hadoop? You can find it by grepping for: jni: conf_set On Mon, Sep 23, 2013 at 12:43 PM, Rolando Martins rolando.mart...@gmail.com wrote: bin/hadoop fs -ls Bad connection to FS. command aborted. exception:

Re: [ceph-users] Hadoop and Ceph integration issues

2013-09-23 Thread Rolando Martins
bin/hadoop fs -ls Bad connection to FS. command aborted. exception: (no other information is thrown) ceph log: 2013-09-23 19:42:27.545402 7f0b58de7700 -1 monclient(hunting): ERROR: missing keyring, cannot use cephx for authentication 2013-09-23 19:42:27.545619 7f0b58de7700 20 client.-1

Re: [ceph-users] Hadoop and Ceph integration issues

2013-09-23 Thread Rolando Martins
2013-09-23 19:42:22.515836 7f0b58de7700 10 jni: conf_read_file: exit ret 0 2013-09-23 19:42:22.515893 7f0b58de7700 10 jni: ceph_mount: / 2013-09-23 19:42:22.516643 7f0b58de7700 -1 monclient(hunting): ERROR: missing keyring, cannot use cephx for authentication 2013-09-23 19:42:22.516969

Re: [ceph-users] ceph-deploy again

2013-09-23 Thread Alfredo Deza
On Mon, Sep 23, 2013 at 11:23 AM, Bernhard Glomm bernhard.gl...@ecologic.eu wrote: Hi all, something with ceph-deploy doesen't work at all anymore. After an upgrade ceph-depoly failed to roll out a new monitor with permission denied. are you root? (obviously there shouldn't be a root login

Re: [ceph-users] how to install radosgw from source code?

2013-09-23 Thread Yehuda Sadeh
On Mon, Sep 23, 2013 at 1:18 AM, yy-nm yxdyours...@gmail.com wrote: hay, folks: i use ceph source code to install a ceph cluster. ceph version 0.61.8 (a6fdcca3bddbc9f177e4e2bf0d9cdd85006b028b) After finish install, i can't find radosgw command? i use below paramter in ceph's installation:

[ceph-users] ceph.conf changes and restarting ceph.

2013-09-23 Thread Snider, Tim
I modified /etc/ceph.conf for no authentication and to specify both private and public networks. /etc/ceph/ceph.conf was distributed to all nodes in the cluster ceph was restarted on all nodes using service ceph -a restart. After that authentication is still required and no ports are open on the

Re: [ceph-users] Hadoop and Ceph integration issues

2013-09-23 Thread Noah Watkins
I'm not sure what you grepped for. Does this output mean that the string conf_set didn't show up in the log? On Mon, Sep 23, 2013 at 12:52 PM, Rolando Martins rolando.mart...@gmail.com wrote: 2013-09-23 19:42:22.515836 7f0b58de7700 10 jni: conf_read_file: exit ret 0 2013-09-23 19:42:22.515893

Re: [ceph-users] Hadoop and Ceph integration issues

2013-09-23 Thread Rolando Martins
My bad, I associated conf_read_file with conf_set. No, it does not appear in the logs. On Mon, Sep 23, 2013 at 4:20 PM, Noah Watkins noah.watk...@inktank.com wrote: I'm not sure what you grepped for. Does this output mean that the string conf_set didn't show up in the log? On Mon, Sep 23,

Re: [ceph-users] Hadoop and Ceph integration issues

2013-09-23 Thread Noah Watkins
Ok thanks. That narrows things down a lot. It seems like the keyring property is not being recognized, and I don't see so I'm wondering if it is possible that the jar file is out of date and doesn't include these configuration features. If you clone http://github.com/ceph/hadoop-common/ and

Re: [ceph-users] Question about Ceph performance

2013-09-23 Thread Gregory Farnum
On Sun, Sep 22, 2013 at 2:35 AM, Dafan Dong don...@yahoo-inc.com wrote: Hi folks, I am Dafan from Yahoo! corp. We are really interested in Ceph now. I wish to know where I can get some performance report about new released DUMPLING? Like throughput, latency with different cluster scale and

Re: [ceph-users] Hadoop and Ceph integration issues

2013-09-23 Thread Rolando Martins
I tried to compile it, but the compilation failed. The error log starts with: compile-core-classes: [taskdef] 2013-09-23 20:59:25,540 INFO mortbay.log (Slf4jLog.java:info(67)) - Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog [javac]

Re: [ceph-users] Hadoop and Ceph integration issues

2013-09-23 Thread Noah Watkins
You need to stick the CephFS jar files in the hadoop lib folder. On Mon, Sep 23, 2013 at 2:02 PM, Rolando Martins rolando.mart...@gmail.com wrote: I tried to compile it, but the compilation failed. The error log starts with: compile-core-classes: [taskdef] 2013-09-23 20:59:25,540 INFO

Re: [ceph-users] Hadoop and Ceph integration issues

2013-09-23 Thread Rolando Martins
Thanks Noah! It worked! I managed to run the wordcount example! Can you remove the jar that is posted online? It is misleading... Thanks! Rolando On Mon, Sep 23, 2013 at 5:07 PM, Noah Watkins noah.watk...@inktank.com wrote: You need to stick the CephFS jar files in the hadoop lib folder.

Re: [ceph-users] Hadoop and Ceph integration issues

2013-09-23 Thread Noah Watkins
Yeh, it should be updating automatically, so it looks like there is an issue with that. So sorry about the headache figuring this out! On Mon, Sep 23, 2013 at 2:25 PM, Rolando Martins rolando.mart...@gmail.com wrote: Thanks Noah! It worked! I managed to run the wordcount example! Can you

Re: [ceph-users] ceph.conf changes and restarting ceph.

2013-09-23 Thread Gary Mazzaferro
Tim Did it work with authentication enabled ? -gary On Mon, Sep 23, 2013 at 2:10 PM, Snider, Tim tim.sni...@netapp.com wrote: I modified /etc/ceph.conf for no authentication and to specify both private and public networks. /etc/ceph/ceph.conf was distributed to all nodes in the

Re: [ceph-users] rgw client

2013-09-23 Thread Samuel Just
You might need to tell cyberduck the location of your endpoint. -Sam On Tue, Sep 17, 2013 at 9:16 PM, lixuehui lixue...@chinacloud.com.cn wrote: Hi,all I installed rgw with a healthy ceph cluster .Although it works well with S3 api ,can it be connected by Cyberduck ? I've tried with the rgw

Re: [ceph-users] Cannot start 5/20 OSDs

2013-09-23 Thread Samuel Just
Can you restart those osds with debug osd = 20 debug filestore = 20 debug ms = 1 in the [osd] section of the ceph.conf file on the respective machines and upload the logs? Sounds like a bug. -Sam On Tue, Sep 17, 2013 at 2:05 PM, Matt Thompson watering...@gmail.com wrote: Hi All, I set up a

Re: [ceph-users] how to install radosgw from source code?

2013-09-23 Thread yy-nm
On 2013/9/24 1:32, Yehuda Sadeh wrote: On Mon, Sep 23, 2013 at 1:18 AM, yy-nm yxdyours...@gmail.com wrote: hay, folks: i use ceph source code to install a ceph cluster. ceph version 0.61.8 (a6fdcca3bddbc9f177e4e2bf0d9cdd85006b028b) After finish install, i can't find radosgw command? i use

Re: [ceph-users] ceph.conf changes and restarting ceph.

2013-09-23 Thread John Wilkins
I will update the Cephx docs. The usage in those docs for restarting is for Debian/Ubuntu deployed with mkcephfs. If you are using Dumpling and deployed with ceph-deploy, you will need to use Upstart. See http://ceph.com/docs/master/rados/operations/operating/#running-ceph-with-upstart for