Re: [ceph-users] ceph-mon fails to start on rasberry pi (raspbian 8.0)

2017-12-16 Thread Andrew Knapp
Joao,

Thanks for the response.  I checked both the log you recommended and
daemon.log, here is the output from each.   If you still would like for me
to upload the log somewhere let me know.

>From /var/log/daemon.log

Dec 16 17:36:47 ceph-master systemd[1]:
[/lib/systemd/system/ceph-mon@.service:24]
Unknown lvalue 'TasksMax' in section 'Service'
Dec 16 17:38:26 ceph-master systemd[1]:
[/lib/systemd/system/ceph-mon@.service:24]
Unknown lvalue 'TasksMax' in section 'Service'
Dec 16 17:38:26 ceph-master systemd[1]: Starting
system-ceph\x2dcreate\x2dkeys.slice.
Dec 16 17:38:26 ceph-master systemd[1]: Created slice
system-ceph\x2dcreate\x2dkeys.slice.
Dec 16 17:38:26 ceph-master systemd[1]: Starting system-ceph\x2dmon.slice.
Dec 16 17:38:26 ceph-master systemd[1]: Created slice
system-ceph\x2dmon.slice.
Dec 16 17:38:26 ceph-master systemd[1]: Starting Ceph cluster key creator
task...
Dec 16 17:38:26 ceph-master systemd[1]: Started Ceph cluster key creator
task.
Dec 16 17:38:26 ceph-master systemd[1]: Starting System Time Synchronized.
Dec 16 17:38:26 ceph-master systemd[1]: Reached target System Time
Synchronized.
Dec 16 17:38:26 ceph-master systemd[1]: Starting Ceph cluster monitor
daemon...
Dec 16 17:38:26 ceph-master systemd[1]: Started Ceph cluster monitor daemon.
Dec 16 17:38:27 ceph-master ceph-create-keys[4582]: admin_socket: exception
getting command descriptions: [Errno 2] No such file or directory
Dec 16 17:38:27 ceph-master ceph-create-keys[4582]:
INFO:ceph-create-keys:ceph-mon admin socket not ready yet.
Dec 16 17:38:28 ceph-master ceph-mon[4583]: *** Caught signal (Segmentation
fault) **
Dec 16 17:38:28 ceph-master ceph-mon[4583]: in thread 756d7c30
thread_name:admin_socket
Dec 16 17:38:28 ceph-master systemd[1]: ceph-mon@ceph-master.service: main
process exited, code=killed, status=11/SEGV
Dec 16 17:38:28 ceph-master ceph-create-keys[4582]: admin_socket: exception
getting command descriptions: exception: [Errno 104] Connection reset by
peer
Dec 16 17:38:28 ceph-master systemd[1]: Unit ceph-mon@ceph-master.service
entered failed state.
Dec 16 17:38:28 ceph-master ceph-create-keys[4582]:
INFO:ceph-create-keys:ceph-mon admin socket not ready yet.
Dec 16 17:38:28 ceph-master systemd[1]: ceph-mon@ceph-master.service
holdoff time over, scheduling restart.
Dec 16 17:38:28 ceph-master systemd[1]: Stopping Ceph cluster monitor
daemon...
Dec 16 17:38:28 ceph-master systemd[1]: Starting Ceph cluster monitor
daemon...
Dec 16 17:38:28 ceph-master systemd[1]: Started Ceph cluster monitor daemon.
Dec 16 17:38:29 ceph-master ceph-mon[4598]: *** Caught signal (Segmentation
fault) **
Dec 16 17:38:29 ceph-master ceph-mon[4598]: in thread 75681c30
thread_name:admin_socket
Dec 16 17:38:29 ceph-master ceph-create-keys[4582]: admin_socket: exception
getting command descriptions: exception: [Errno 104] Connection reset by
peer
Dec 16 17:38:29 ceph-master systemd[1]: ceph-mon@ceph-master.service: main
process exited, code=killed, status=11/SEGV
Dec 16 17:38:29 ceph-master systemd[1]: Unit ceph-mon@ceph-master.service
entered failed state.
Dec 16 17:38:29 ceph-master ceph-create-keys[4582]:
INFO:ceph-create-keys:ceph-mon admin socket not ready yet.
Dec 16 17:38:30 ceph-master systemd[1]: ceph-mon@ceph-master.service
holdoff time over, scheduling restart.
Dec 16 17:38:30 ceph-master systemd[1]: Stopping Ceph cluster monitor
daemon...
Dec 16 17:38:30 ceph-master systemd[1]: Starting Ceph cluster monitor
daemon...
Dec 16 17:38:30 ceph-master systemd[1]: Started Ceph cluster monitor daemon.
Dec 16 17:38:31 ceph-master ceph-mon[4610]: *** Caught signal (Segmentation
fault) **


>From /var/log/ceph/ceph-mon.ceph-master.log

2017-12-16 17:38:27.300345 76ff4a10  0 set uid:gid to 64045:64045
(ceph:ceph)
2017-12-16 17:38:27.300666 76ff4a10  0 ceph version 10.2.5
(c461ee19ecbc0c5c330aca20f7392c9a00730367), process ceph-mon, pid 4583
2017-12-16 17:38:27.300886 76ff4a10  0 pidfile_write: ignore empty
--pid-file
2017-12-16 17:38:28.834076 76f9ea10  0 set uid:gid to 64045:64045
(ceph:ceph)
2017-12-16 17:38:28.834145 76f9ea10  0 ceph version 10.2.5
(c461ee19ecbc0c5c330aca20f7392c9a00730367), process ceph-mon, pid 4598
2017-12-16 17:38:28.834246 76f9ea10  0 pidfile_write: ignore empty
--pid-file
2017-12-16 17:38:30.393237 76fa9a10  0 set uid:gid to 64045:64045
(ceph:ceph)
2017-12-16 17:38:30.393302 76fa9a10  0 ceph version 10.2.5
(c461ee19ecbc0c5c330aca20f7392c9a00730367), process ceph-mon, pid 4610
2017-12-16 17:38:30.393421 76fa9a10  0 pidfile_write: ignore empty
--pid-file


Do you see anything here that points to a config issue?




On Fri, Dec 15, 2017 at 8:08 PM, Joao Eduardo Luis  wrote:

> On 12/15/2017 07:03 PM, Andrew Knapp wrote:
>
>> Has anyone else tried this and had similar problems?  Any advice on how
>> to proceed or work around this issue?
>>
>
> The daemon's log, somewhere in /var/log/ceph/ceph-mon..log, should
> have more info. Upload that somewhere and we'll take a look.
>
>   -Joao
> _

Re: [ceph-users] ceph-mon fails to start on rasberry pi (raspbian 8.0)

2017-12-15 Thread Joao Eduardo Luis

On 12/15/2017 07:03 PM, Andrew Knapp wrote:
Has anyone else tried this and had similar problems?  Any advice on how 
to proceed or work around this issue?


The daemon's log, somewhere in /var/log/ceph/ceph-mon..log, should 
have more info. Upload that somewhere and we'll take a look.


  -Joao
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com


[ceph-users] ceph-mon fails to start on rasberry pi (raspbian 8.0)

2017-12-15 Thread Andrew Knapp
I recently purchased 3 raspberry pi nodes to create a small storage cluster
to test with at my home.  I found a couple of procedures on setting this up
so it appears folks have successfully done this (
https://www.linkedin.com/pulse/ceph-raspberry-pi-rahul-vijayan/).

I am running Raspbian GNU/Linux 8.0 (jessie).  I'm using ceph-deploy to
install the cluster and it appears to install version 10.2.5-7.2+rpi1 of
the ceph ARM packages.

When I try to start the ceph-mon service I get the following error from
systemd:

Dec 14 19:59:46 ceph-master systemd[1]: Starting Ceph cluster monitor
daemon...
Dec 14 19:59:46 ceph-master systemd[1]: Started Ceph cluster monitor
daemon.
Dec 14 19:59:47 ceph-master ceph-mon[28237]: *** Caught signal
(Segmentation fault) **
Dec 14 19:59:47 ceph-master ceph-mon[28237]: in thread 756a5c30
thread_name:admin_socket
Dec 14 19:59:47 ceph-master systemd[1]: ceph-mon@ceph-master.service:
main process exited, code=killed, status=11/SEGV
Dec 14 19:59:47 ceph-master systemd[1]: Unit
ceph-mon@ceph-master.service entered failed state.
Dec 14 19:59:47 ceph-master systemd[1]: ceph-mon@ceph-master.service
holdoff time over, scheduling restart.
Dec 14 19:59:47 ceph-master systemd[1]: Stopping Ceph cluster monitor
daemon...
Dec 14 19:59:47 ceph-master systemd[1]: Starting Ceph cluster monitor
daemon...
Dec 14 19:59:47 ceph-master systemd[1]: Started Ceph cluster monitor
daemon.
Dec 14 19:59:49 ceph-master ceph-mon[28256]: *** Caught signal
(Segmentation fault) **
Dec 14 19:59:49 ceph-master ceph-mon[28256]: in thread 75654c30
thread_name:admin_socket
Dec 14 19:59:49 ceph-master ceph-mon[28256]: ceph version 10.2.5
(c461ee19ecbc0c5c330aca20f7392c9a00730367)
Dec 14 19:59:49 ceph-master ceph-mon[28256]: 1: (()+0x4b1348)
[0x54fae348]
Dec 14 19:59:49 ceph-master ceph-mon[28256]: 2:
(__default_sa_restorer()+0) [0x768bb480]
Dec 14 19:59:49 ceph-master ceph-mon[28256]: 3:
(AdminSocket::do_accept()+0x28) [0x550ca154]
Dec 14 19:59:49 ceph-master ceph-mon[28256]: 4:
(AdminSocket::entry()+0x22c) [0x550cc458]
Dec 14 19:59:49 ceph-master systemd[1]: ceph-mon@ceph-master.service:
main process exited, code=killed, status=11/SEGV
Dec 14 19:59:49 ceph-master systemd[1]: Unit
ceph-mon@ceph-master.service entered failed state.
Dec 14 19:59:49 ceph-master systemd[1]: ceph-mon@ceph-master.service
holdoff time over, scheduling restart.
Dec 14 19:59:49 ceph-master systemd[1]: Stopping Ceph cluster monitor
daemon...
Dec 14 19:59:49 ceph-master systemd[1]: Starting Ceph cluster monitor
daemon...
Dec 14 19:59:49 ceph-master systemd[1]: Started Ceph cluster monitor
daemon.
Dec 14 19:59:50 ceph-master ceph-mon[28271]: *** Caught signal
(Segmentation fault) **
Dec 14 19:59:50 ceph-master ceph-mon[28271]: in thread 755fcc30
thread_name:admin_socket
Dec 14 19:59:50 ceph-master systemd[1]: ceph-mon@ceph-master.service:
main process exited, code=killed, status=11/SEGV
Dec 14 19:59:50 ceph-master systemd[1]: Unit
ceph-mon@ceph-master.service entered failed state.
Dec 14 19:59:50 ceph-master systemd[1]: ceph-mon@ceph-master.service
holdoff time over, scheduling restart.
Dec 14 19:59:50 ceph-master systemd[1]: Stopping Ceph cluster monitor
daemon...
Dec 14 19:59:50 ceph-master systemd[1]: Starting Ceph cluster monitor
daemon...
Dec 14 19:59:50 ceph-master systemd[1]: ceph-mon@ceph-master.service
start request repeated too quickly, refusing to start.
Dec 14 19:59:50 ceph-master systemd[1]: Failed to start Ceph cluster
monitor daemon.
Dec 14 19:59:50 ceph-master systemd[1]: Unit
ceph-mon@ceph-master.service entered failed state.

I'm looking for guidance here as I'm not sure why this doesn't work.  I am
using the following URLs for my apt repos:

root@ceph-master:~# cat /etc/apt/sources.list
deb http://mirrordirector.raspbian.org/raspbian/ testing main contrib
non-free rpi

root@ceph-master:~# cat /etc/apt/sources.list.d/ceph.list
deb https://download.ceph.com/debian-jewel/ jessie main

Has anyone else tried this and had similar problems?  Any advice on how to
proceed or work around this issue?
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com