Re: [ceph-users] mount cephfs from a public network ip of mds

2018-09-29 Thread David Turner
The cluster/private network is only used by the OSDs. Nothing else in ceph or its clients communicate using it. Everything other than osd to osd communication uses the public network. That includes the MONs, MDSs, clients, and anything other than an osd talking to an osd. Nothing else other than os

Re: [ceph-users] Any backfill in our cluster makes the cluster unusable and takes forever

2018-09-29 Thread Pavan Rallabhandi
I looked at one of my test clusters running Jewel on Ubuntu 16.04, and interestingly I found this(below) in one of the OSD logs, which is different from your OSD boot log, where none of the compression algorithms seem to be supported. This hints more at how rocksdb was built on CentOS for Ceph.

Re: [ceph-users] mount cephfs from a public network ip of mds

2018-09-29 Thread Paul Emmerich
All Ceph clients will always first connect to the mons. Mons provide further information on the cluster such as the IPs of MDS and OSDs. This means you need to provide the mon IPs to the mount command, not the MDS IPs. Your first command works by coincidence since you seem to run the mons and MDS'

[ceph-users] mount cephfs from a public network ip of mds

2018-09-29 Thread Joshua Chen
Hello all, I am testing the cephFS cluster so that clients could mount -t ceph. the cluster has 6 nodes, 3 mons (also mds), and 3 osds. All these 6 nodes has 2 nic, one 1Gb nic with real ip (140.109.0.0) and 1 10Gb nic with virtual ip (10.32.0.0) 140.109. Nic1 1G<-MDS1->Nic2 10G 10.32. 140.