Hi , I have created a ceph cluster on centos 7 Servers and it is working fine with tcp and able to run all benchmarks.
Now want to check the same with rdma and I followed the below link to deploy the same https://community.mellanox.com/docs/DOC-2721 After following the above document and when I Restart all cluster processes on the monitor node: using sudo systemctl start ceph-mon.target The monitors are not coming up. Any help here will be great. If I manually run the below command instead of using systemctl the server is rebooting sudo /usr/bin/ceph-mon --cluster ceph --id clx-ssp-056 --setuser ceph --setgroup ceph Below is my ceph.conf configuration file and iam using soft ROCE as my rdma device. [global] fsid = 74cc4723-7ab9-4cc3-b8c8-182e138da955 mon_initial_members = TestNVMe2 mon_host = 10.38.32.245 auth_cluster_required = cephx auth_service_required = cephx auth_client_required = cephx public network = 10.38.32.0/24 osd pool default size = 2 osd_max_object_name_len = 256 osd_max_object_namespace_len = 64 ms_type = async+rdma ms_cluster_type = async+rdma ms_async_rdma_device_name = rxe0 ms_async_rdma_polling_us = 0 ms_async_rdma_local_gid = 0000:0000:0000:0000:0000:ffff:0a26:20f5 ms_async_rdma_port_num = 1 Regards, Muneendra.
_______________________________________________ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com