Hi,
We assimilated our Ceph configuration to store attributes within Ceph itself
and subsequently have a minimal configuration file. Whilst this works perfectly
we are unable to remove configuration entries populated by the assimilate-conf
command.
Ceph Nautilus 14.2.4.1 upgrade notes:
cd /etc/pve;
ceph config assimilate-conf -i ceph.conf -o ceph.conf.new;
mv ceph.conf.new ceph.conf;
pico /etc/ceph/ceph.conf
# add back: cluster_network
# public_network
ceph config rm global cluster_network;
ceph config rm global public_network;
ceph config set global mon_osd_down_out_subtree_limit host;
Resulting minimal Ceph configuration file:
[admin@kvm1c ~]# cat /etc/ceph/ceph.conf
[global]
cluster_network = 10.248.1.0/24
filestore_xattr_use_omap = true
fsid = 31f6ea46-12cb-47e8-a6f3-60fb6bbd1782
mon_host = 10.248.1.60 10.248.1.61 10.248.1.62
public_network = 10.248.1.0/24
[client]
keyring = /etc/pve/priv/$cluster.$name.keyring
Ceph configuration entries:
[admin@kvm1c ~]# ceph config dump
WHO MASK LEVEL OPTION VALUE RO
global advanced auth_client_required cephx *
global advanced auth_cluster_required cephx *
global advanced auth_service_required cephx *
global advanced cluster_network 10.248.1.0/24 *
global advanced debug_filestore 0/0
global advanced debug_journal 0/0
global advanced debug_ms 0/0
global advanced debug_osd 0/0
global basic device_failure_prediction_mode cloud
global advanced mon_allow_pool_delete true
global advanced mon_osd_down_out_subtree_limit host
global advanced osd_deep_scrub_interval 1209600.000000
global advanced osd_pool_default_min_size 2
global advanced osd_pool_default_size 3
global advanced osd_scrub_begin_hour 19
global advanced osd_scrub_end_hour 6
global advanced osd_scrub_sleep 0.100000
global advanced public_network 10.248.1.0/24 *
global advanced rbd_default_features 7
global advanced rbd_default_features 31
mgr advanced mgr/balancer/active true
mgr advanced mgr/balancer/mode upmap
mgr advanced mgr/devicehealth/enable_monitoring true
Note the duplicate 'rdb_default_features' entry. We've switched to kernel 5.3
which supports object-map and fast-diff and subsequently wanted to change the
default features for new RBD images to reflect this.
Commands we entered to get here:
[admin@kvm1b ~]# ceph config dump | grep -e WHO -e rbd_default_features
WHO MASK LEVEL OPTION VALUE RO
global advanced rbd_default_features 7
[admin@kvm1b ~]# ceph config rm global rbd_default_features
[admin@kvm1b ~]# ceph config rm global rbd_default_features
[admin@kvm1b ~]# ceph config rm global rbd_default_features
[admin@kvm1b ~]# ceph config dump | grep -e WHO -e rbd_default_features
WHO MASK LEVEL OPTION VALUE RO
global advanced rbd_default_features 7
[admin@kvm1b ~]# ceph config set global rbd_default_features 31
[admin@kvm1b ~]# ceph config dump | grep -e WHO -e rbd_default_features
WHO MASK LEVEL OPTION VALUE RO
global advanced rbd_default_features 7
global advanced rbd_default_features 31
Regards
David Herselman
_______________________________________________
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
