Yeh, it should be updating automatically, so it looks like there is an
issue with that. So sorry about the headache figuring this out!
On Mon, Sep 23, 2013 at 2:25 PM, Rolando Martins
wrote:
> Thanks Noah!
> It worked!
> I managed to run the wordcount example!
>
> Can you remove the jar that is
Thanks Noah!
It worked!
I managed to run the wordcount example!
Can you remove the jar that is posted online? It is misleading...
Thanks!
Rolando
On Mon, Sep 23, 2013 at 5:07 PM, Noah Watkins wrote:
> You need to stick the CephFS jar files in the hadoop lib folder.
>
> On Mon, Sep 23, 2013 a
You need to stick the CephFS jar files in the hadoop lib folder.
On Mon, Sep 23, 2013 at 2:02 PM, Rolando Martins
wrote:
> I tried to compile it, but the compilation failed.
> The error log starts with:
> compile-core-classes:
> [taskdef] 2013-09-23 20:59:25,540 INFO mortbay.log
> (Slf4jLog.ja
I tried to compile it, but the compilation failed.
The error log starts with:
compile-core-classes:
[taskdef] 2013-09-23 20:59:25,540 INFO mortbay.log
(Slf4jLog.java:info(67)) - Logging to
org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via
org.mortbay.log.Slf4jLog
[javac] /home/ubuntu/Pr
Ok thanks. That narrows things down a lot. It seems like the keyring
property is not being recognized, and I don't see so I'm wondering if
it is possible that the jar file is out of date and doesn't include
these configuration features.
If you clone http://github.com/ceph/hadoop-common/ and check
My bad, I associated conf_read_file with conf_set.
No, it does not appear in the logs.
On Mon, Sep 23, 2013 at 4:20 PM, Noah Watkins wrote:
> I'm not sure what you grepped for. Does this output mean that the
> string "conf_set" didn't show up in the log?
>
> On Mon, Sep 23, 2013 at 12:52 PM, Rola
I'm not sure what you grepped for. Does this output mean that the
string "conf_set" didn't show up in the log?
On Mon, Sep 23, 2013 at 12:52 PM, Rolando Martins
wrote:
> 2013-09-23 19:42:22.515836 7f0b58de7700 10 jni: conf_read_file: exit ret 0
> 2013-09-23 19:42:22.515893 7f0b58de7700 10 jni: ce
2013-09-23 19:42:22.515836 7f0b58de7700 10 jni: conf_read_file: exit ret 0
2013-09-23 19:42:22.515893 7f0b58de7700 10 jni: ceph_mount: /
2013-09-23 19:42:22.516643 7f0b58de7700 -1 monclient(hunting): ERROR:
missing keyring, cannot use cephx for authentication
2013-09-23 19:42:22.516969 7f0b58de7700
bin/hadoop fs -ls
Bad connection to FS. command aborted. exception:
(no other information is thrown)
ceph log:
2013-09-23 19:42:27.545402 7f0b58de7700 -1 monclient(hunting): ERROR:
missing keyring, cannot use cephx for authentication
2013-09-23 19:42:27.545619 7f0b58de7700 20 client.-1 trim_cach
In the log file that you showing, do you see where the keyring file is
being set by Hadoop? You can find it by grepping for: "jni: conf_set"
On Mon, Sep 23, 2013 at 12:43 PM, Rolando Martins
wrote:
> bin/hadoop fs -ls
>
> Bad connection to FS. command aborted. exception:
>
> (no other information
What happens when you run `bin/hadoop fs -ls` ? This is entirely
local, and a bit simpler and easier to grok.
On Mon, Sep 23, 2013 at 12:23 PM, Rolando Martins
wrote:
> I am trying to start hadoop using bin/start-mapred.sh.
> In the HADOOP_HOME/lib, I have:
> lib/hadoop-cephfs.jar lib/libcephfs.
I am trying to start hadoop using bin/start-mapred.sh.
In the HADOOP_HOME/lib, I have:
lib/hadoop-cephfs.jar lib/libcephfs.jar lib/libcephfs_jni.so
(the first I downloaded from
http://ceph.com/docs/master/cephfs/hadoop/ and the other two, I copied
from my system (after installing the ubuntu packa
How are you invoking Hadoop? Also, I forgot to ask, are you using the
wrappers located in github.com/ceph/hadoop-common (or the jar linked
to on http://ceph.com/docs/master/cephfs/hadoop/)?
On Mon, Sep 23, 2013 at 12:05 PM, Rolando Martins
wrote:
> Hi Noah,
> I enabled the debugging and got:
>
>
Hi Noah,
I enabled the debugging and got:
2013-09-23 18:59:34.705894 7f0b58de7700 -1 monclient(hunting): ERROR:
missing keyring, cannot use cephx for authentication
2013-09-23 18:59:34.706106 7f0b58de7700 20 client.-1 trim_cache size 0 max 0
2013-09-23 18:59:34.706225 7f0b58de7700 10 jni: ceph_mou
Hi Noah,
updated the core-site.xml (bellow).
All the nodes have the same files. But the problem remains the same.
What is the value for "ceph.auth.keyring"? Is the path containing the
file "ceph.mon.keyring"?
Thanks,
Rolando
P.S.: I have the cephFS mounted locally, so the cluster is ok.
cluste
Shoot, I thought I had it figured out :)
There is a default admin user created when you first create your
cluster. After a typical install via ceph-deploy, there should be a
file called 'ceph.client.admin.keyring', usually sibling to ceph.conf.
If this is in a standard location (e.g. /etc/ceph) yo
>
> ceph.root.dir
> /mnt/mycephfs
>
This is probably causing the issue. Is this meant to be a local mount
point? The 'ceph.root.dir' property specifies the root directory
/inside/ CephFS, and the Hadoop implementation doesn't require a local
CephFS mount--it uses a client library
Hi all,
trying to test ceph with hadoop without success.
I deployed the ceph cluster using ceph-deploy.
Hadoop - 1.1.3
ceph version 0.67.3
Does anyone had success on making this work?
ceph.conf
[global]
fsid = d9ca74d0-d9f4-436d-92de-762af67c6534
mon initial members = hyrax1, hyrax2, hyrax3, hyra
18 matches
Mail list logo
