Re: [ceph-users] 3-node cluster with 3 x Intel Optane 900P - very low benchmarked performance (200 IOPS)?

2019-03-11 Thread David Clarke
ate=1, whichever is appropriate for your CPUs and kernel, in the boot cmdline. -- David Clarke Systems Architect Catalyst IT signature.asc Description: OpenPGP digital signature ___ ceph-users mailing list ceph-users@lists.ceph.com http://lis

Re: [ceph-users] Fwd: Can't get fullpartition space

2017-08-17 Thread David Clarke
should. From 'ceph-disk list': Correct: /dev/sda : /dev/sda1 ceph data, active, cluster ceph, osd.0, block /dev/sda2 /dev/sda2 ceph block, for /dev/sda1 Shared OS disk: /dev/sdc : /dev/sdc1 other, linux_raid_member /dev/sdc2 other, linux_raid_member /dev/sdc3 other, linux_raid

Re: [ceph-users] How to Rebuild libvirt + qemu packages with Ceph support on Debian 9.0 Stretch

2017-07-09 Thread David Clarke
It has a dependency on such things as librados2, librbd1 (for Ceph) and glusterfs-common, libiscsi7, etc. From the package description: "This package provides extra block device backend modules for qemu-system emulation and qemu-img from qemu-utils package, which are rarely used and has extr

Re: [ceph-users] New cluster - configuration tips and reccomendation - NVMe

2017-07-05 Thread David Clarke
oposed? There are notes on ceph.com regarding flash, and NVMe in particular, deployments: http://tracker.ceph.com/projects/ceph/wiki/Tuning_for_All_Flash_Deployments -- David Clarke Systems Architect Catalyst IT signature.asc Description: OpenPGP digital signature __

Re: [ceph-users] Performance with encrypted OSDs

2016-03-20 Thread David Clarke
defaults you need to set parameters in ceph.conf to something like: osd_dmcrypt_type = luks osd_cryptsetup_parameters = --cipher aes-xts-plain64 osd_dmcrypt_key_size = 512 [0] https://en.wikipedia.org/wiki/Disk_encryption_theory#XEX-based_tweaked-codebook_mode_with_ciphertext_stealing_.28XTS.29 --

Re: [ceph-users] OSD:s failing out after upgrade to 9.2.0 on Ubuntu 14.04

2015-11-16 Thread David Clarke
in Hammer, as well as fixing interoperability issues that are required before an upgrade to Infernalis. That is, all users of earlier version of Hammer or any version of Firefly will first need to upgrade to hammer v0.94.4 or later before upgrading to Infernalis (or future releases)." [0

Re: [ceph-users] Using straw2 crush also with Hammer

2015-11-11 Thread David Clarke
u enable straw2. > > > I believe straw2 only requires monitor support -- unlike the tuna led > involved in executing CRUSH, straw2 is just about how the OSD/bucket > weights get converted into a sort of "internal" straw weight. That's > done on the monitors and enc

Re: [ceph-users] ceph-deploy for "deb http://ceph.com/debian-hammer/ trusty main"

2015-10-22 Thread David Clarke
kages files, so it looks like something has gone awry with the repository build scripts. A direct download in available at: http://download.ceph.com/debian-hammer/pool/main/c/ceph-deploy/ceph-deploy_1.5.28trusty_all.deb That version does not include /usr/share/man/man8/ceph-deploy.8.gz, and so does not

Re: [ceph-users] rsync broken?

2015-09-28 Thread David Clarke
ny current ceph download site download.ceph.com::ceph seems to work for us. -- David Clarke signature.asc Description: OpenPGP digital signature ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] debian repositories path change?

2015-09-21 Thread David Clarke
ealand) mirror. Is there an intention to re-enable this on either download.ceph.com, or the EU equivalent? -- David Clarke signature.asc Description: OpenPGP digital signature ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] Getting placement groups to place evenly (again)

2015-04-07 Thread David Clarke
assumes that the amount of data in a pool corresponds closely with the number of PGs it has. In any case, I'd recommend more capacity. At that level of utilisation a node failure or two could very quickly cause OSDs to fill even if they're well balanced. -- David Clarke Systems Archi

Re: [ceph-users] rbd read speed only 1/4 of write speed

2014-12-16 Thread David Clarke
e worth investigating read ahead options on the storage nodes themselves, both at the OS and disk controller levels. This isn't something we've yet been able to test, however. - -- David Clarke Systems Architect Catalyst IT -BEGIN PGP SIGNATURE- Version: GnuPG v1

Re: [ceph-users] rebooting nodes in a ceph cluster

2013-12-19 Thread David Clarke
want to investigate kexec[0] ('kexec-tools' package in Debian derived distributions) in order to get your machines rebooting quicker. It essentially re-loads the kernel as the last step of the shutdown procedure, skipping over the lengthy BIOS/UEFI/controller firmware etc boot stage

Re: [ceph-users] CloudStack + KVM(Ubuntu 12.04, Libvirt 1.0.2) + Ceph [Seeking Help]

2013-10-21 Thread David Clarke
qed qcow2 qcow parallels nbd dmg tftp ftps ft p https http cow cloop >> bochs blkverify >> blkdebug > > These settings all look fine too. The key for client.libvirt is 'AQBx+F5ScBQlLhAAYCH8qhGEh/gjKW+NpziAlA==', whereas the key being passed to KVM is '+F5ScBQ