Hi, /var/log/ceph/ceph-osd.0.log is attached. My sdb is 128MB and sdc (journal) is 16MB:
[root@server0 ~]# ceph-disk list /dev/dm-0 other, xfs, mounted on / /dev/dm-1 swap, swap /dev/sda : /dev/sda1 other, 0x83 /dev/sda2 other, xfs, mounted on /boot /dev/sda3 other, LVM2_member /dev/sdb : /dev/sdb1 ceph data, active, cluster ceph, osd.0, journal /dev/sdc1 /dev/sdc : /dev/sdc1 ceph journal, for /dev/sdb1 Marcin On Thu, Aug 31, 2017 at 3:05 PM, Sage Weil <s...@newdream.net> wrote: > Hi Marcin, > > Can you reproduce the crash with 'debug bluestore = 20' set, and then > ceph-post-file /var/log/ceph/ceph-osd.0.log? > > My guess is that we're not handling a very small device properly? > > sage > > > On Thu, 31 Aug 2017, Marcin Dulak wrote: > > > Hi, > > > > I have a virtual CentOS 7.3 test setup at: > > https://github.com/marcindulak/github-test-local/ > blob/a339ff7505267545f593f > > d949a6453a56cdfd7fe/vagrant-ceph-rbd-tutorial-centos7.sh > > > > It seems to crash reproducibly with luminous, and works with kraken. > > Is this a known issue? > > > > [ceph_deploy.conf][DEBUG ] found configuration file at: > > /home/ceph/.cephdeploy.conf > > [ceph_deploy.cli][INFO ] Invoked (1.5.37): /bin/ceph-deploy osd activate > > server0:/dev/sdb1:/dev/sdc server1:/dev/sdb1:/dev/sdc > > server2:/dev/sdb1:/dev/sdc > > [ceph_deploy.cli][INFO ] ceph-deploy options: > > [ceph_deploy.cli][INFO ] username : None > > [ceph_deploy.cli][INFO ] verbose : False > > [ceph_deploy.cli][INFO ] overwrite_conf : False > > [ceph_deploy.cli][INFO ] subcommand : activate > > [ceph_deploy.cli][INFO ] quiet : False > > [ceph_deploy.cli][INFO ] cd_conf : > > <ceph_deploy.conf.cephdeploy.Conf instance at 0x10ae710> > > [ceph_deploy.cli][INFO ] cluster : ceph > > [ceph_deploy.cli][INFO ] func : <function osd > at > > 0x109fb90> > > [ceph_deploy.cli][INFO ] ceph_conf : None > > [ceph_deploy.cli][INFO ] default_release : False > > [ceph_deploy.cli][INFO ] disk : [('server0', > > '/dev/sdb1', '/dev/sdc'), ('server1', '/dev/sdb1', '/dev/sdc'), > ('server2', > > '/dev/sdb1', '/dev/sdc')] > > [ceph_deploy.osd][DEBUG ] Activating cluster ceph disks > > server0:/dev/sdb1:/dev/sdc server1:/dev/sdb1:/dev/sdc > > server2:/dev/sdb1:/dev/sdc > > [server0][DEBUG ] connection detected need for sudo > > [server0][DEBUG ] connected to host: server0 > > [server0][DEBUG ] detect platform information from remote host > > [server0][DEBUG ] detect machine type > > [server0][DEBUG ] find the location of an executable > > [ceph_deploy.osd][INFO ] Distro info: CentOS Linux 7.3.1611 Core > > [ceph_deploy.osd][DEBUG ] activating host server0 disk /dev/sdb1 > > [ceph_deploy.osd][DEBUG ] will use init type: systemd > > [server0][DEBUG ] find the location of an executable > > [server0][INFO ] Running command: sudo /usr/sbin/ceph-disk -v activate > > --mark-init systemd --mount /dev/sdb1 > > [server0][WARNIN] main_activate: path = /dev/sdb1 > > [server0][WARNIN] get_dm_uuid: get_dm_uuid /dev/sdb1 uuid path is > > /sys/dev/block/8:17/dm/uuid > > [server0][WARNIN] command: Running command: /sbin/blkid -o udev -p > /dev/sdb1 > > [server0][WARNIN] command: Running command: /sbin/blkid -p -s TYPE -o > value > > -- /dev/sdb1 > > [server0][WARNIN] command: Running command: /usr/bin/ceph-conf > > --cluster=ceph --name=osd. --lookup osd_mount_options_xfs > > [server0][WARNIN] command: Running command: /usr/bin/ceph-conf > > --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs > > [server0][WARNIN] mount: Mounting /dev/sdb1 on > /var/lib/ceph/tmp/mnt.wfKzzb > > with options noatime,inode64 > > [server0][WARNIN] command_check_call: Running command: /usr/bin/mount -t > xfs > > -o noatime,inode64 -- /dev/sdb1 /var/lib/ceph/tmp/mnt.wfKzzb > > [server0][WARNIN] command: Running command: /sbin/restorecon > > /var/lib/ceph/tmp/mnt.wfKzzb > > [server0][WARNIN] activate: Cluster uuid is > > 04e79ca9-308c-41a5-b40d-a2737c34238d > > [server0][WARNIN] command: Running command: /usr/bin/ceph-osd > --cluster=ceph > > --show-config-value=fsid > > [server0][WARNIN] activate: Cluster name is ceph > > [server0][WARNIN] activate: OSD uuid is 46d7cc0b-a087-4c8c-b00c- > ff584c941cf9 > > [server0][WARNIN] activate: OSD id is 0 > > [server0][WARNIN] activate: Initializing OSD... > > [server0][WARNIN] command_check_call: Running command: /usr/bin/ceph > > --cluster ceph --name client.bootstrap-osd --keyring > > /var/lib/ceph/bootstrap-osd/ceph.keyring mon getmap -o > > /var/lib/ceph/tmp/mnt.wfKzzb/activate.monmap > > [server0][WARNIN] got monmap epoch 1 > > [server0][WARNIN] command_check_call: Running command: /usr/bin/ceph-osd > > --cluster ceph --mkfs -i 0 --monmap > > /var/lib/ceph/tmp/mnt.wfKzzb/activate.monmap --osd-data > > /var/lib/ceph/tmp/mnt.wfKzzb --osd-uuid 46d7cc0b-a087-4c8c-b00c- > ff584c941cf9 > > --setuser ceph --setgroup ceph > > [server0][WARNIN]/home/jenkins-build/build/workspace/ > ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x > > 86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/ > huge/release/12.2.0/ > > rpm/el7/BUILD/ceph-12.2.0/src/os/bluestore/BlueFS.cc: In function 'void > > BlueFS::add_block_extent(unsigned int, uint64_t, uint64_t)' thread > > 7fef4f0cfd00 time 2017-08-31 10:05:31.892519 > > [server0][WARNIN]/home/jenkins-build/build/workspace/ > ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x > > 86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/ > huge/release/12.2.0/ > > rpm/el7/BUILD/ceph-12.2.0/src/os/bluestore/BlueFS.cc: 172: FAILED > > assert(bdev[id]->get_size() >= offset + length) > > [server0][WARNIN] ceph version 12.2.0 > > (32ce2a3ae5239ee33d6150705cdb24d43bab910c) luminous (rc) > > [server0][WARNIN] 1: (ceph::__ceph_assert_fail(char const*, char const*, > > int, char const*)+0x110) [0x7fef4fb4c510] > > [server0][WARNIN] 2: (BlueFS::add_block_extent(unsigned int, unsigned > long, > > unsigned long)+0x4d8) [0x7fef4fad1f88] > > [server0][WARNIN] 3: (BlueStore::_open_db(bool)+0xc4f) [0x7fef4f9f597f] > > [server0][WARNIN] 4: (BlueStore::mkfs()+0xd0d) [0x7fef4f9ff99d] > > [server0][WARNIN] 5: (OSD::mkfs(CephContext*, ObjectStore*, std::string > > const&, uuid_d, int)+0x29b) [0x7fef4f5b6f1b] > > [server0][WARNIN] 6: (main()+0xf42) [0x7fef4f4f6972] > > [server0][WARNIN] 7: (__libc_start_main()+0xf5) [0x7fef4b72fb35] > > [server0][WARNIN] 8: (()+0x4acb56) [0x7fef4f596b56] > > > > Cheers, > > > > Marcin > > > > >
2017-08-31 23:05:31.571475 7f2f3fb7ed00 0 set uid:gid to 1001:1001 (ceph:ceph) 2017-08-31 23:05:31.571494 7f2f3fb7ed00 0 ceph version 12.2.0 (32ce2a3ae5239ee33d6150705cdb24d43bab910c) luminous (rc), process (unknown), pid 7060 2017-08-31 23:05:31.571649 7f2f3fb7ed00 10 bluestore(/var/lib/ceph/tmp/mnt.nRchwF) set_cache_shards 1 2017-08-31 23:05:31.589045 7f2f3fb7ed00 10 bluestore(/var/lib/ceph/tmp/mnt.nRchwF) _set_csum csum_type crc32c 2017-08-31 23:05:31.590082 7f2f3fb7ed00 1 bluestore(/var/lib/ceph/tmp/mnt.nRchwF) mkfs path /var/lib/ceph/tmp/mnt.nRchwF 2017-08-31 23:05:31.590118 7f2f3fb7ed00 20 bluestore(/var/lib/ceph/tmp/mnt.nRchwF) _setup_block_symlink_or_file name block path size 10737418240 create=1 2017-08-31 23:05:31.590340 7f2f3fb7ed00 20 bluestore(/var/lib/ceph/tmp/mnt.nRchwF) _setup_block_symlink_or_file name block.wal path size 100663296 create=0 2017-08-31 23:05:31.590346 7f2f3fb7ed00 20 bluestore(/var/lib/ceph/tmp/mnt.nRchwF) _setup_block_symlink_or_file name block.db path size 0 create=0 2017-08-31 23:05:31.590361 7f2f3fb7ed00 1 bdev create path /var/lib/ceph/tmp/mnt.nRchwF/block type kernel 2017-08-31 23:05:31.590366 7f2f3fb7ed00 1 bdev(0x7f2f4b73c800 /var/lib/ceph/tmp/mnt.nRchwF/block) open path /var/lib/ceph/tmp/mnt.nRchwF/block 2017-08-31 23:05:31.590737 7f2f3fb7ed00 1 bdev(0x7f2f4b73c800 /var/lib/ceph/tmp/mnt.nRchwF/block) open size 28291072 (0x1afb000, 27628 kB) block_size 4096 (4096 B) rotational 2017-08-31 23:05:31.590749 7f2f3fb7ed00 10 bluestore(/var/lib/ceph/tmp/mnt.nRchwF/block) _write_bdev_label path /var/lib/ceph/tmp/mnt.nRchwF/block label bdev(osd_uuid 55ffcfe9-cc63-49ef-9ef7-383999d8627b size 0x1afb000 btime 2017-08-31 23:05:31.590747 desc main) 2017-08-31 23:05:31.590795 7f2f3fb7ed00 1 bluestore(/var/lib/ceph/tmp/mnt.nRchwF) _set_cache_sizes max 0.5 < ratio 0.99 2017-08-31 23:05:31.590812 7f2f3fb7ed00 1 bluestore(/var/lib/ceph/tmp/mnt.nRchwF) _set_cache_sizes cache_size 1073741824 meta 0.5 kv 0.5 data 0 2017-08-31 23:05:31.590818 7f2f3fb7ed00 10 bluestore(/var/lib/ceph/tmp/mnt.nRchwF) _open_db kv_backend = rocksdb 2017-08-31 23:05:31.590820 7f2f3fb7ed00 10 bluestore(/var/lib/ceph/tmp/mnt.nRchwF) _open_db do_bluefs = 1 2017-08-31 23:05:31.590820 7f2f3fb7ed00 10 bluestore(/var/lib/ceph/tmp/mnt.nRchwF) _open_db initializing bluefs 2017-08-31 23:05:31.590836 7f2f3fb7ed00 1 bdev create path /var/lib/ceph/tmp/mnt.nRchwF/block type kernel 2017-08-31 23:05:31.590838 7f2f3fb7ed00 1 bdev(0x7f2f4b9cd000 /var/lib/ceph/tmp/mnt.nRchwF/block) open path /var/lib/ceph/tmp/mnt.nRchwF/block 2017-08-31 23:05:31.590929 7f2f3fb7ed00 1 bdev(0x7f2f4b9cd000 /var/lib/ceph/tmp/mnt.nRchwF/block) open size 28291072 (0x1afb000, 27628 kB) block_size 4096 (4096 B) rotational 2017-08-31 23:05:31.590934 7f2f3fb7ed00 1 bluefs add_block_device bdev 1 path /var/lib/ceph/tmp/mnt.nRchwF/block size 27628 kB 2017-08-31 23:05:31.590937 7f2f3fb7ed00 1 bluefs add_block_extent bdev 1 0x7fffffffe0d00000~40000000 2017-08-31 23:05:31.593142 7f2f3fb7ed00 -1 /home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/12.2.0/rpm/el7/BUILD/ceph-12.2.0/src/os/bluestore/BlueFS.cc: In function 'void BlueFS::add_block_extent(unsigned int, uint64_t, uint64_t)' thread 7f2f3fb7ed00 time 2017-08-31 23:05:31.590939 /home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/12.2.0/rpm/el7/BUILD/ceph-12.2.0/src/os/bluestore/BlueFS.cc: 172: FAILED assert(bdev[id]->get_size() >= offset + length) ceph version 12.2.0 (32ce2a3ae5239ee33d6150705cdb24d43bab910c) luminous (rc) 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x110) [0x7f2f405fb510] 2: (BlueFS::add_block_extent(unsigned int, unsigned long, unsigned long)+0x4d8) [0x7f2f40580f88] 3: (BlueStore::_open_db(bool)+0xc4f) [0x7f2f404a497f] 4: (BlueStore::mkfs()+0xd0d) [0x7f2f404ae99d] 5: (OSD::mkfs(CephContext*, ObjectStore*, std::string const&, uuid_d, int)+0x29b) [0x7f2f40065f1b] 6: (main()+0xf42) [0x7f2f3ffa5972] 7: (__libc_start_main()+0xf5) [0x7f2f3c1deb35] 8: (()+0x4acb56) [0x7f2f40045b56] NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this. --- begin dump of recent events --- -63> 2017-08-31 23:05:31.563828 7f2f3fb7ed00 5 asok(0x7f2f4b7521c0) register_command perfcounters_dump hook 0x7f2f4b6fa190 -62> 2017-08-31 23:05:31.563841 7f2f3fb7ed00 5 asok(0x7f2f4b7521c0) register_command 1 hook 0x7f2f4b6fa190 -61> 2017-08-31 23:05:31.563843 7f2f3fb7ed00 5 asok(0x7f2f4b7521c0) register_command perf dump hook 0x7f2f4b6fa190 -60> 2017-08-31 23:05:31.563845 7f2f3fb7ed00 5 asok(0x7f2f4b7521c0) register_command perfcounters_schema hook 0x7f2f4b6fa190 -59> 2017-08-31 23:05:31.563852 7f2f3fb7ed00 5 asok(0x7f2f4b7521c0) register_command perf histogram dump hook 0x7f2f4b6fa190 -58> 2017-08-31 23:05:31.563855 7f2f3fb7ed00 5 asok(0x7f2f4b7521c0) register_command 2 hook 0x7f2f4b6fa190 -57> 2017-08-31 23:05:31.563857 7f2f3fb7ed00 5 asok(0x7f2f4b7521c0) register_command perf schema hook 0x7f2f4b6fa190 -56> 2017-08-31 23:05:31.563858 7f2f3fb7ed00 5 asok(0x7f2f4b7521c0) register_command perf histogram schema hook 0x7f2f4b6fa190 -55> 2017-08-31 23:05:31.563860 7f2f3fb7ed00 5 asok(0x7f2f4b7521c0) register_command perf reset hook 0x7f2f4b6fa190 -54> 2017-08-31 23:05:31.563861 7f2f3fb7ed00 5 asok(0x7f2f4b7521c0) register_command config show hook 0x7f2f4b6fa190 -53> 2017-08-31 23:05:31.563863 7f2f3fb7ed00 5 asok(0x7f2f4b7521c0) register_command config help hook 0x7f2f4b6fa190 -52> 2017-08-31 23:05:31.563865 7f2f3fb7ed00 5 asok(0x7f2f4b7521c0) register_command config set hook 0x7f2f4b6fa190 -51> 2017-08-31 23:05:31.563867 7f2f3fb7ed00 5 asok(0x7f2f4b7521c0) register_command config get hook 0x7f2f4b6fa190 -50> 2017-08-31 23:05:31.563877 7f2f3fb7ed00 5 asok(0x7f2f4b7521c0) register_command config diff hook 0x7f2f4b6fa190 -49> 2017-08-31 23:05:31.563880 7f2f3fb7ed00 5 asok(0x7f2f4b7521c0) register_command config diff get hook 0x7f2f4b6fa190 -48> 2017-08-31 23:05:31.563882 7f2f3fb7ed00 5 asok(0x7f2f4b7521c0) register_command log flush hook 0x7f2f4b6fa190 -47> 2017-08-31 23:05:31.563883 7f2f3fb7ed00 5 asok(0x7f2f4b7521c0) register_command log dump hook 0x7f2f4b6fa190 -46> 2017-08-31 23:05:31.563885 7f2f3fb7ed00 5 asok(0x7f2f4b7521c0) register_command log reopen hook 0x7f2f4b6fa190 -45> 2017-08-31 23:05:31.563890 7f2f3fb7ed00 5 asok(0x7f2f4b7521c0) register_command dump_mempools hook 0x7f2f4b8d1b08 -44> 2017-08-31 23:05:31.571475 7f2f3fb7ed00 0 set uid:gid to 1001:1001 (ceph:ceph) -43> 2017-08-31 23:05:31.571494 7f2f3fb7ed00 0 ceph version 12.2.0 (32ce2a3ae5239ee33d6150705cdb24d43bab910c) luminous (rc), process (unknown), pid 7060 -42> 2017-08-31 23:05:31.571539 7f2f3fb7ed00 5 object store type is bluestore -41> 2017-08-31 23:05:31.571649 7f2f3fb7ed00 10 bluestore(/var/lib/ceph/tmp/mnt.nRchwF) set_cache_shards 1 -40> 2017-08-31 23:05:31.589045 7f2f3fb7ed00 10 bluestore(/var/lib/ceph/tmp/mnt.nRchwF) _set_csum csum_type crc32c -39> 2017-08-31 23:05:31.589059 7f2f3fb7ed00 5 asok(0x7f2f4b7521c0) init /var/run/ceph/ceph-osd.0.asok -38> 2017-08-31 23:05:31.589077 7f2f3fb7ed00 5 asok(0x7f2f4b7521c0) bind_and_listen /var/run/ceph/ceph-osd.0.asok -37> 2017-08-31 23:05:31.589378 7f2f3fb7ed00 5 asok(0x7f2f4b7521c0) register_command 0 hook 0x7f2f4b6f6180 -36> 2017-08-31 23:05:31.589383 7f2f3fb7ed00 5 asok(0x7f2f4b7521c0) register_command version hook 0x7f2f4b6f6180 -35> 2017-08-31 23:05:31.589386 7f2f3fb7ed00 5 asok(0x7f2f4b7521c0) register_command git_version hook 0x7f2f4b6f6180 -34> 2017-08-31 23:05:31.589388 7f2f3fb7ed00 5 asok(0x7f2f4b7521c0) register_command help hook 0x7f2f4b6fa290 -33> 2017-08-31 23:05:31.589389 7f2f3fb7ed00 5 asok(0x7f2f4b7521c0) register_command get_command_descriptions hook 0x7f2f4b6fa2a0 -32> 2017-08-31 23:05:31.589432 7f2f3fb7ed00 10 monclient: build_initial_monmap -31> 2017-08-31 23:05:31.589507 7f2f3fb7ed00 10 monclient: get_monmap_privately -30> 2017-08-31 23:05:31.589819 7f2f3975c700 5 asok(0x7f2f4b7521c0) entry start -29> 2017-08-31 23:05:31.589835 7f2f38f5b700 2 Event(0x7f2f4b73cc80 nevent=5000 time_id=1).set_owner idx=0 owner=139840795817728 -28> 2017-08-31 23:05:31.589865 7f2f3875a700 2 Event(0x7f2f4b73d480 nevent=5000 time_id=1).set_owner idx=1 owner=139840787425024 -27> 2017-08-31 23:05:31.589877 7f2f37f59700 2 Event(0x7f2f4b73ce80 nevent=5000 time_id=1).set_owner idx=2 owner=139840779032320 -26> 2017-08-31 23:05:31.589905 7f2f3fb7ed00 1 Processor -- start -25> 2017-08-31 23:05:31.589944 7f2f3fb7ed00 1 -- - start start -24> 2017-08-31 23:05:31.589947 7f2f3fb7ed00 10 monclient: have 1 fsid cbc93c9d-f4ee-4039-b738-c09cb52bff9c -23> 2017-08-31 23:05:31.589960 7f2f3fb7ed00 1 -- - shutdown_connections -22> 2017-08-31 23:05:31.590027 7f2f3fb7ed00 1 -- - shutdown_connections -21> 2017-08-31 23:05:31.590042 7f2f3fb7ed00 1 -- - wait complete. -20> 2017-08-31 23:05:31.590046 7f2f3fb7ed00 1 -- - >> - conn(0x7f2f4ba9e000 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down -19> 2017-08-31 23:05:31.590053 7f2f3fb7ed00 2 -- - >> - conn(0x7f2f4ba9e000 :-1 s=STATE_NONE pgs=0 cs=0 l=0)._stop -18> 2017-08-31 23:05:31.590082 7f2f3fb7ed00 1 bluestore(/var/lib/ceph/tmp/mnt.nRchwF) mkfs path /var/lib/ceph/tmp/mnt.nRchwF -17> 2017-08-31 23:05:31.590118 7f2f3fb7ed00 20 bluestore(/var/lib/ceph/tmp/mnt.nRchwF) _setup_block_symlink_or_file name block path size 10737418240 create=1 -16> 2017-08-31 23:05:31.590340 7f2f3fb7ed00 20 bluestore(/var/lib/ceph/tmp/mnt.nRchwF) _setup_block_symlink_or_file name block.wal path size 100663296 create=0 -15> 2017-08-31 23:05:31.590346 7f2f3fb7ed00 20 bluestore(/var/lib/ceph/tmp/mnt.nRchwF) _setup_block_symlink_or_file name block.db path size 0 create=0 -14> 2017-08-31 23:05:31.590361 7f2f3fb7ed00 1 bdev create path /var/lib/ceph/tmp/mnt.nRchwF/block type kernel -13> 2017-08-31 23:05:31.590366 7f2f3fb7ed00 1 bdev(0x7f2f4b73c800 /var/lib/ceph/tmp/mnt.nRchwF/block) open path /var/lib/ceph/tmp/mnt.nRchwF/block -12> 2017-08-31 23:05:31.590737 7f2f3fb7ed00 1 bdev(0x7f2f4b73c800 /var/lib/ceph/tmp/mnt.nRchwF/block) open size 28291072 (0x1afb000, 27628 kB) block_size 4096 (4096 B) rotational -11> 2017-08-31 23:05:31.590749 7f2f3fb7ed00 10 bluestore(/var/lib/ceph/tmp/mnt.nRchwF/block) _write_bdev_label path /var/lib/ceph/tmp/mnt.nRchwF/block label bdev(osd_uuid 55ffcfe9-cc63-49ef-9ef7-383999d8627b size 0x1afb000 btime 2017-08-31 23:05:31.590747 desc main) -10> 2017-08-31 23:05:31.590795 7f2f3fb7ed00 1 bluestore(/var/lib/ceph/tmp/mnt.nRchwF) _set_cache_sizes max 0.5 < ratio 0.99 -9> 2017-08-31 23:05:31.590812 7f2f3fb7ed00 1 bluestore(/var/lib/ceph/tmp/mnt.nRchwF) _set_cache_sizes cache_size 1073741824 meta 0.5 kv 0.5 data 0 -8> 2017-08-31 23:05:31.590818 7f2f3fb7ed00 10 bluestore(/var/lib/ceph/tmp/mnt.nRchwF) _open_db kv_backend = rocksdb -7> 2017-08-31 23:05:31.590820 7f2f3fb7ed00 10 bluestore(/var/lib/ceph/tmp/mnt.nRchwF) _open_db do_bluefs = 1 -6> 2017-08-31 23:05:31.590820 7f2f3fb7ed00 10 bluestore(/var/lib/ceph/tmp/mnt.nRchwF) _open_db initializing bluefs -5> 2017-08-31 23:05:31.590836 7f2f3fb7ed00 1 bdev create path /var/lib/ceph/tmp/mnt.nRchwF/block type kernel -4> 2017-08-31 23:05:31.590838 7f2f3fb7ed00 1 bdev(0x7f2f4b9cd000 /var/lib/ceph/tmp/mnt.nRchwF/block) open path /var/lib/ceph/tmp/mnt.nRchwF/block -3> 2017-08-31 23:05:31.590929 7f2f3fb7ed00 1 bdev(0x7f2f4b9cd000 /var/lib/ceph/tmp/mnt.nRchwF/block) open size 28291072 (0x1afb000, 27628 kB) block_size 4096 (4096 B) rotational -2> 2017-08-31 23:05:31.590934 7f2f3fb7ed00 1 bluefs add_block_device bdev 1 path /var/lib/ceph/tmp/mnt.nRchwF/block size 27628 kB -1> 2017-08-31 23:05:31.590937 7f2f3fb7ed00 1 bluefs add_block_extent bdev 1 0x7fffffffe0d00000~40000000 0> 2017-08-31 23:05:31.593142 7f2f3fb7ed00 -1 /home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/12.2.0/rpm/el7/BUILD/ceph-12.2.0/src/os/bluestore/BlueFS.cc: In function 'void BlueFS::add_block_extent(unsigned int, uint64_t, uint64_t)' thread 7f2f3fb7ed00 time 2017-08-31 23:05:31.590939 /home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/12.2.0/rpm/el7/BUILD/ceph-12.2.0/src/os/bluestore/BlueFS.cc: 172: FAILED assert(bdev[id]->get_size() >= offset + length) ceph version 12.2.0 (32ce2a3ae5239ee33d6150705cdb24d43bab910c) luminous (rc) 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x110) [0x7f2f405fb510] 2: (BlueFS::add_block_extent(unsigned int, unsigned long, unsigned long)+0x4d8) [0x7f2f40580f88] 3: (BlueStore::_open_db(bool)+0xc4f) [0x7f2f404a497f] 4: (BlueStore::mkfs()+0xd0d) [0x7f2f404ae99d] 5: (OSD::mkfs(CephContext*, ObjectStore*, std::string const&, uuid_d, int)+0x29b) [0x7f2f40065f1b] 6: (main()+0xf42) [0x7f2f3ffa5972] 7: (__libc_start_main()+0xf5) [0x7f2f3c1deb35] 8: (()+0x4acb56) [0x7f2f40045b56] NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this. --- logging levels --- 0/ 5 none 0/ 1 lockdep 0/ 1 context 1/ 1 crush 1/ 5 mds 1/ 5 mds_balancer 1/ 5 mds_locker 1/ 5 mds_log 1/ 5 mds_log_expire 1/ 5 mds_migrator 0/ 1 buffer 0/ 1 timer 0/ 1 filer 0/ 1 striper 0/ 1 objecter 0/ 5 rados 0/ 5 rbd 0/ 5 rbd_mirror 0/ 5 rbd_replay 0/ 5 journaler 0/ 5 objectcacher 0/ 5 client 1/ 5 osd 0/ 5 optracker 0/ 5 objclass 1/ 3 filestore 1/ 3 journal 0/ 5 ms 1/ 5 mon 0/10 monc 1/ 5 paxos 0/ 5 tp 1/ 5 auth 1/ 5 crypto 1/ 1 finisher 1/ 5 heartbeatmap 1/ 5 perfcounter 1/ 5 rgw 1/10 civetweb 1/ 5 javaclient 1/ 5 asok 1/ 1 throttle 0/ 0 refs 1/ 5 xio 1/ 5 compressor 20/20 bluestore 1/ 5 bluefs 1/ 3 bdev 1/ 5 kstore 4/ 5 rocksdb 4/ 5 leveldb 4/ 5 memdb 1/ 5 kinetic 1/ 5 fuse 1/ 5 mgr 1/ 5 mgrc 1/ 5 dpdk 1/ 5 eventtrace -2/-2 (syslog threshold) -1/-1 (stderr threshold) max_recent 10000 max_new 1000 log_file /var/log/ceph/ceph-osd.0.log --- end dump of recent events --- 2017-08-31 23:05:31.595501 7f2f3fb7ed00 -1 *** Caught signal (Aborted) ** in thread 7f2f3fb7ed00 thread_name:ceph-osd ceph version 12.2.0 (32ce2a3ae5239ee33d6150705cdb24d43bab910c) luminous (rc) 1: (()+0xa23b21) [0x7f2f405bcb21] 2: (()+0xf370) [0x7f2f3d1c8370] 3: (gsignal()+0x37) [0x7f2f3c1f21d7] 4: (abort()+0x148) [0x7f2f3c1f38c8] 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x284) [0x7f2f405fb684] 6: (BlueFS::add_block_extent(unsigned int, unsigned long, unsigned long)+0x4d8) [0x7f2f40580f88] 7: (BlueStore::_open_db(bool)+0xc4f) [0x7f2f404a497f] 8: (BlueStore::mkfs()+0xd0d) [0x7f2f404ae99d] 9: (OSD::mkfs(CephContext*, ObjectStore*, std::string const&, uuid_d, int)+0x29b) [0x7f2f40065f1b] 10: (main()+0xf42) [0x7f2f3ffa5972] 11: (__libc_start_main()+0xf5) [0x7f2f3c1deb35] 12: (()+0x4acb56) [0x7f2f40045b56] NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this. --- begin dump of recent events --- 0> 2017-08-31 23:05:31.595501 7f2f3fb7ed00 -1 *** Caught signal (Aborted) ** in thread 7f2f3fb7ed00 thread_name:ceph-osd ceph version 12.2.0 (32ce2a3ae5239ee33d6150705cdb24d43bab910c) luminous (rc) 1: (()+0xa23b21) [0x7f2f405bcb21] 2: (()+0xf370) [0x7f2f3d1c8370] 3: (gsignal()+0x37) [0x7f2f3c1f21d7] 4: (abort()+0x148) [0x7f2f3c1f38c8] 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x284) [0x7f2f405fb684] 6: (BlueFS::add_block_extent(unsigned int, unsigned long, unsigned long)+0x4d8) [0x7f2f40580f88] 7: (BlueStore::_open_db(bool)+0xc4f) [0x7f2f404a497f] 8: (BlueStore::mkfs()+0xd0d) [0x7f2f404ae99d] 9: (OSD::mkfs(CephContext*, ObjectStore*, std::string const&, uuid_d, int)+0x29b) [0x7f2f40065f1b] 10: (main()+0xf42) [0x7f2f3ffa5972] 11: (__libc_start_main()+0xf5) [0x7f2f3c1deb35] 12: (()+0x4acb56) [0x7f2f40045b56] NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this. --- logging levels --- 0/ 5 none 0/ 1 lockdep 0/ 1 context 1/ 1 crush 1/ 5 mds 1/ 5 mds_balancer 1/ 5 mds_locker 1/ 5 mds_log 1/ 5 mds_log_expire 1/ 5 mds_migrator 0/ 1 buffer 0/ 1 timer 0/ 1 filer 0/ 1 striper 0/ 1 objecter 0/ 5 rados 0/ 5 rbd 0/ 5 rbd_mirror 0/ 5 rbd_replay 0/ 5 journaler 0/ 5 objectcacher 0/ 5 client 1/ 5 osd 0/ 5 optracker 0/ 5 objclass 1/ 3 filestore 1/ 3 journal 0/ 5 ms 1/ 5 mon 0/10 monc 1/ 5 paxos 0/ 5 tp 1/ 5 auth 1/ 5 crypto 1/ 1 finisher 1/ 5 heartbeatmap 1/ 5 perfcounter 1/ 5 rgw 1/10 civetweb 1/ 5 javaclient 1/ 5 asok 1/ 1 throttle 0/ 0 refs 1/ 5 xio 1/ 5 compressor 20/20 bluestore 1/ 5 bluefs 1/ 3 bdev 1/ 5 kstore 4/ 5 rocksdb 4/ 5 leveldb 4/ 5 memdb 1/ 5 kinetic 1/ 5 fuse 1/ 5 mgr 1/ 5 mgrc 1/ 5 dpdk 1/ 5 eventtrace -2/-2 (syslog threshold) -1/-1 (stderr threshold) max_recent 10000 max_new 1000 log_file /var/log/ceph/ceph-osd.0.log --- end dump of recent events --- 2017-08-31 23:05:32.168964 7f46398e5d00 0 set uid:gid to 1001:1001 (ceph:ceph) 2017-08-31 23:05:32.168980 7f46398e5d00 0 ceph version 12.2.0 (32ce2a3ae5239ee33d6150705cdb24d43bab910c) luminous (rc), process (unknown), pid 7136 2017-08-31 23:05:32.169171 7f46398e5d00 10 bluestore(/var/lib/ceph/tmp/mnt.Nsg_MB) set_cache_shards 1 2017-08-31 23:05:32.186251 7f46398e5d00 10 bluestore(/var/lib/ceph/tmp/mnt.Nsg_MB) _set_csum csum_type crc32c 2017-08-31 23:05:32.187466 7f46398e5d00 1 bluestore(/var/lib/ceph/tmp/mnt.Nsg_MB) mkfs path /var/lib/ceph/tmp/mnt.Nsg_MB 2017-08-31 23:05:32.187504 7f46398e5d00 20 bluestore(/var/lib/ceph/tmp/mnt.Nsg_MB) _setup_block_symlink_or_file name block path size 10737418240 create=1 2017-08-31 23:05:32.187638 7f46398e5d00 20 bluestore(/var/lib/ceph/tmp/mnt.Nsg_MB) _setup_block_symlink_or_file name block.wal path size 100663296 create=0 2017-08-31 23:05:32.187650 7f46398e5d00 20 bluestore(/var/lib/ceph/tmp/mnt.Nsg_MB) _setup_block_symlink_or_file name block.db path size 0 create=0 2017-08-31 23:05:32.187694 7f46398e5d00 1 bdev create path /var/lib/ceph/tmp/mnt.Nsg_MB/block type kernel 2017-08-31 23:05:32.187699 7f46398e5d00 1 bdev(0x7f4643ce0400 /var/lib/ceph/tmp/mnt.Nsg_MB/block) open path /var/lib/ceph/tmp/mnt.Nsg_MB/block 2017-08-31 23:05:32.187955 7f46398e5d00 1 bdev(0x7f4643ce0400 /var/lib/ceph/tmp/mnt.Nsg_MB/block) open size 28291072 (0x1afb000, 27628 kB) block_size 4096 (4096 B) rotational 2017-08-31 23:05:32.187968 7f46398e5d00 10 bluestore(/var/lib/ceph/tmp/mnt.Nsg_MB/block) _write_bdev_label path /var/lib/ceph/tmp/mnt.Nsg_MB/block label bdev(osd_uuid 55ffcfe9-cc63-49ef-9ef7-383999d8627b size 0x1afb000 btime 2017-08-31 23:05:32.187967 desc main) 2017-08-31 23:05:32.188018 7f46398e5d00 1 bluestore(/var/lib/ceph/tmp/mnt.Nsg_MB) _set_cache_sizes max 0.5 < ratio 0.99 2017-08-31 23:05:32.188037 7f46398e5d00 1 bluestore(/var/lib/ceph/tmp/mnt.Nsg_MB) _set_cache_sizes cache_size 1073741824 meta 0.5 kv 0.5 data 0 2017-08-31 23:05:32.188044 7f46398e5d00 10 bluestore(/var/lib/ceph/tmp/mnt.Nsg_MB) _open_db kv_backend = rocksdb 2017-08-31 23:05:32.188045 7f46398e5d00 10 bluestore(/var/lib/ceph/tmp/mnt.Nsg_MB) _open_db do_bluefs = 1 2017-08-31 23:05:32.188046 7f46398e5d00 10 bluestore(/var/lib/ceph/tmp/mnt.Nsg_MB) _open_db initializing bluefs 2017-08-31 23:05:32.188061 7f46398e5d00 1 bdev create path /var/lib/ceph/tmp/mnt.Nsg_MB/block type kernel 2017-08-31 23:05:32.188063 7f46398e5d00 1 bdev(0x7f4643f71000 /var/lib/ceph/tmp/mnt.Nsg_MB/block) open path /var/lib/ceph/tmp/mnt.Nsg_MB/block 2017-08-31 23:05:32.188203 7f46398e5d00 1 bdev(0x7f4643f71000 /var/lib/ceph/tmp/mnt.Nsg_MB/block) open size 28291072 (0x1afb000, 27628 kB) block_size 4096 (4096 B) rotational 2017-08-31 23:05:32.188208 7f46398e5d00 1 bluefs add_block_device bdev 1 path /var/lib/ceph/tmp/mnt.Nsg_MB/block size 27628 kB 2017-08-31 23:05:32.188211 7f46398e5d00 1 bluefs add_block_extent bdev 1 0x7fffffffe0d00000~40000000 2017-08-31 23:05:32.190431 7f46398e5d00 -1 /home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/12.2.0/rpm/el7/BUILD/ceph-12.2.0/src/os/bluestore/BlueFS.cc: In function 'void BlueFS::add_block_extent(unsigned int, uint64_t, uint64_t)' thread 7f46398e5d00 time 2017-08-31 23:05:32.188213 /home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/12.2.0/rpm/el7/BUILD/ceph-12.2.0/src/os/bluestore/BlueFS.cc: 172: FAILED assert(bdev[id]->get_size() >= offset + length) ceph version 12.2.0 (32ce2a3ae5239ee33d6150705cdb24d43bab910c) luminous (rc) 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x110) [0x7f463a362510] 2: (BlueFS::add_block_extent(unsigned int, unsigned long, unsigned long)+0x4d8) [0x7f463a2e7f88] 3: (BlueStore::_open_db(bool)+0xc4f) [0x7f463a20b97f] 4: (BlueStore::mkfs()+0xd0d) [0x7f463a21599d] 5: (OSD::mkfs(CephContext*, ObjectStore*, std::string const&, uuid_d, int)+0x29b) [0x7f4639dccf1b] 6: (main()+0xf42) [0x7f4639d0c972] 7: (__libc_start_main()+0xf5) [0x7f4635f45b35] 8: (()+0x4acb56) [0x7f4639dacb56] NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this. --- begin dump of recent events --- -63> 2017-08-31 23:05:32.162260 7f46398e5d00 5 asok(0x7f4643cf61c0) register_command perfcounters_dump hook 0x7f4643c9e190 -62> 2017-08-31 23:05:32.162273 7f46398e5d00 5 asok(0x7f4643cf61c0) register_command 1 hook 0x7f4643c9e190 -61> 2017-08-31 23:05:32.162276 7f46398e5d00 5 asok(0x7f4643cf61c0) register_command perf dump hook 0x7f4643c9e190 -60> 2017-08-31 23:05:32.162277 7f46398e5d00 5 asok(0x7f4643cf61c0) register_command perfcounters_schema hook 0x7f4643c9e190 -59> 2017-08-31 23:05:32.162279 7f46398e5d00 5 asok(0x7f4643cf61c0) register_command perf histogram dump hook 0x7f4643c9e190 -58> 2017-08-31 23:05:32.162280 7f46398e5d00 5 asok(0x7f4643cf61c0) register_command 2 hook 0x7f4643c9e190 -57> 2017-08-31 23:05:32.162282 7f46398e5d00 5 asok(0x7f4643cf61c0) register_command perf schema hook 0x7f4643c9e190 -56> 2017-08-31 23:05:32.162283 7f46398e5d00 5 asok(0x7f4643cf61c0) register_command perf histogram schema hook 0x7f4643c9e190 -55> 2017-08-31 23:05:32.162285 7f46398e5d00 5 asok(0x7f4643cf61c0) register_command perf reset hook 0x7f4643c9e190 -54> 2017-08-31 23:05:32.162286 7f46398e5d00 5 asok(0x7f4643cf61c0) register_command config show hook 0x7f4643c9e190 -53> 2017-08-31 23:05:32.162287 7f46398e5d00 5 asok(0x7f4643cf61c0) register_command config help hook 0x7f4643c9e190 -52> 2017-08-31 23:05:32.162289 7f46398e5d00 5 asok(0x7f4643cf61c0) register_command config set hook 0x7f4643c9e190 -51> 2017-08-31 23:05:32.162291 7f46398e5d00 5 asok(0x7f4643cf61c0) register_command config get hook 0x7f4643c9e190 -50> 2017-08-31 23:05:32.162297 7f46398e5d00 5 asok(0x7f4643cf61c0) register_command config diff hook 0x7f4643c9e190 -49> 2017-08-31 23:05:32.162300 7f46398e5d00 5 asok(0x7f4643cf61c0) register_command config diff get hook 0x7f4643c9e190 -48> 2017-08-31 23:05:32.162301 7f46398e5d00 5 asok(0x7f4643cf61c0) register_command log flush hook 0x7f4643c9e190 -47> 2017-08-31 23:05:32.162303 7f46398e5d00 5 asok(0x7f4643cf61c0) register_command log dump hook 0x7f4643c9e190 -46> 2017-08-31 23:05:32.162304 7f46398e5d00 5 asok(0x7f4643cf61c0) register_command log reopen hook 0x7f4643c9e190 -45> 2017-08-31 23:05:32.162310 7f46398e5d00 5 asok(0x7f4643cf61c0) register_command dump_mempools hook 0x7f4643e75b08 -44> 2017-08-31 23:05:32.168964 7f46398e5d00 0 set uid:gid to 1001:1001 (ceph:ceph) -43> 2017-08-31 23:05:32.168980 7f46398e5d00 0 ceph version 12.2.0 (32ce2a3ae5239ee33d6150705cdb24d43bab910c) luminous (rc), process (unknown), pid 7136 -42> 2017-08-31 23:05:32.169060 7f46398e5d00 5 object store type is bluestore -41> 2017-08-31 23:05:32.169171 7f46398e5d00 10 bluestore(/var/lib/ceph/tmp/mnt.Nsg_MB) set_cache_shards 1 -40> 2017-08-31 23:05:32.186251 7f46398e5d00 10 bluestore(/var/lib/ceph/tmp/mnt.Nsg_MB) _set_csum csum_type crc32c -39> 2017-08-31 23:05:32.186264 7f46398e5d00 5 asok(0x7f4643cf61c0) init /var/run/ceph/ceph-osd.0.asok -38> 2017-08-31 23:05:32.186279 7f46398e5d00 5 asok(0x7f4643cf61c0) bind_and_listen /var/run/ceph/ceph-osd.0.asok -37> 2017-08-31 23:05:32.186728 7f46398e5d00 5 asok(0x7f4643cf61c0) register_command 0 hook 0x7f4643c9a180 -36> 2017-08-31 23:05:32.186735 7f46398e5d00 5 asok(0x7f4643cf61c0) register_command version hook 0x7f4643c9a180 -35> 2017-08-31 23:05:32.186737 7f46398e5d00 5 asok(0x7f4643cf61c0) register_command git_version hook 0x7f4643c9a180 -34> 2017-08-31 23:05:32.186739 7f46398e5d00 5 asok(0x7f4643cf61c0) register_command help hook 0x7f4643c9e290 -33> 2017-08-31 23:05:32.186741 7f46398e5d00 5 asok(0x7f4643cf61c0) register_command get_command_descriptions hook 0x7f4643c9e2a0 -32> 2017-08-31 23:05:32.186825 7f46398e5d00 10 monclient: build_initial_monmap -31> 2017-08-31 23:05:32.186878 7f46398e5d00 10 monclient: get_monmap_privately -30> 2017-08-31 23:05:32.187205 7f46334c3700 5 asok(0x7f4643cf61c0) entry start -29> 2017-08-31 23:05:32.187222 7f4632cc2700 2 Event(0x7f4643ce0e80 nevent=5000 time_id=1).set_owner idx=0 owner=139939476678400 -28> 2017-08-31 23:05:32.187249 7f46324c1700 2 Event(0x7f4643ce1480 nevent=5000 time_id=1).set_owner idx=1 owner=139939468285696 -27> 2017-08-31 23:05:32.187261 7f4631cc0700 2 Event(0x7f4643ce0c80 nevent=5000 time_id=1).set_owner idx=2 owner=139939459892992 -26> 2017-08-31 23:05:32.187288 7f46398e5d00 1 Processor -- start -25> 2017-08-31 23:05:32.187317 7f46398e5d00 1 -- - start start -24> 2017-08-31 23:05:32.187320 7f46398e5d00 10 monclient: have 1 fsid cbc93c9d-f4ee-4039-b738-c09cb52bff9c -23> 2017-08-31 23:05:32.187339 7f46398e5d00 1 -- - shutdown_connections -22> 2017-08-31 23:05:32.187409 7f46398e5d00 1 -- - shutdown_connections -21> 2017-08-31 23:05:32.187424 7f46398e5d00 1 -- - wait complete. -20> 2017-08-31 23:05:32.187428 7f46398e5d00 1 -- - >> - conn(0x7f4644042000 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down -19> 2017-08-31 23:05:32.187435 7f46398e5d00 2 -- - >> - conn(0x7f4644042000 :-1 s=STATE_NONE pgs=0 cs=0 l=0)._stop -18> 2017-08-31 23:05:32.187466 7f46398e5d00 1 bluestore(/var/lib/ceph/tmp/mnt.Nsg_MB) mkfs path /var/lib/ceph/tmp/mnt.Nsg_MB -17> 2017-08-31 23:05:32.187504 7f46398e5d00 20 bluestore(/var/lib/ceph/tmp/mnt.Nsg_MB) _setup_block_symlink_or_file name block path size 10737418240 create=1 -16> 2017-08-31 23:05:32.187638 7f46398e5d00 20 bluestore(/var/lib/ceph/tmp/mnt.Nsg_MB) _setup_block_symlink_or_file name block.wal path size 100663296 create=0 -15> 2017-08-31 23:05:32.187650 7f46398e5d00 20 bluestore(/var/lib/ceph/tmp/mnt.Nsg_MB) _setup_block_symlink_or_file name block.db path size 0 create=0 -14> 2017-08-31 23:05:32.187694 7f46398e5d00 1 bdev create path /var/lib/ceph/tmp/mnt.Nsg_MB/block type kernel -13> 2017-08-31 23:05:32.187699 7f46398e5d00 1 bdev(0x7f4643ce0400 /var/lib/ceph/tmp/mnt.Nsg_MB/block) open path /var/lib/ceph/tmp/mnt.Nsg_MB/block -12> 2017-08-31 23:05:32.187955 7f46398e5d00 1 bdev(0x7f4643ce0400 /var/lib/ceph/tmp/mnt.Nsg_MB/block) open size 28291072 (0x1afb000, 27628 kB) block_size 4096 (4096 B) rotational -11> 2017-08-31 23:05:32.187968 7f46398e5d00 10 bluestore(/var/lib/ceph/tmp/mnt.Nsg_MB/block) _write_bdev_label path /var/lib/ceph/tmp/mnt.Nsg_MB/block label bdev(osd_uuid 55ffcfe9-cc63-49ef-9ef7-383999d8627b size 0x1afb000 btime 2017-08-31 23:05:32.187967 desc main) -10> 2017-08-31 23:05:32.188018 7f46398e5d00 1 bluestore(/var/lib/ceph/tmp/mnt.Nsg_MB) _set_cache_sizes max 0.5 < ratio 0.99 -9> 2017-08-31 23:05:32.188037 7f46398e5d00 1 bluestore(/var/lib/ceph/tmp/mnt.Nsg_MB) _set_cache_sizes cache_size 1073741824 meta 0.5 kv 0.5 data 0 -8> 2017-08-31 23:05:32.188044 7f46398e5d00 10 bluestore(/var/lib/ceph/tmp/mnt.Nsg_MB) _open_db kv_backend = rocksdb -7> 2017-08-31 23:05:32.188045 7f46398e5d00 10 bluestore(/var/lib/ceph/tmp/mnt.Nsg_MB) _open_db do_bluefs = 1 -6> 2017-08-31 23:05:32.188046 7f46398e5d00 10 bluestore(/var/lib/ceph/tmp/mnt.Nsg_MB) _open_db initializing bluefs -5> 2017-08-31 23:05:32.188061 7f46398e5d00 1 bdev create path /var/lib/ceph/tmp/mnt.Nsg_MB/block type kernel -4> 2017-08-31 23:05:32.188063 7f46398e5d00 1 bdev(0x7f4643f71000 /var/lib/ceph/tmp/mnt.Nsg_MB/block) open path /var/lib/ceph/tmp/mnt.Nsg_MB/block -3> 2017-08-31 23:05:32.188203 7f46398e5d00 1 bdev(0x7f4643f71000 /var/lib/ceph/tmp/mnt.Nsg_MB/block) open size 28291072 (0x1afb000, 27628 kB) block_size 4096 (4096 B) rotational -2> 2017-08-31 23:05:32.188208 7f46398e5d00 1 bluefs add_block_device bdev 1 path /var/lib/ceph/tmp/mnt.Nsg_MB/block size 27628 kB -1> 2017-08-31 23:05:32.188211 7f46398e5d00 1 bluefs add_block_extent bdev 1 0x7fffffffe0d00000~40000000 0> 2017-08-31 23:05:32.190431 7f46398e5d00 -1 /home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/12.2.0/rpm/el7/BUILD/ceph-12.2.0/src/os/bluestore/BlueFS.cc: In function 'void BlueFS::add_block_extent(unsigned int, uint64_t, uint64_t)' thread 7f46398e5d00 time 2017-08-31 23:05:32.188213 /home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/12.2.0/rpm/el7/BUILD/ceph-12.2.0/src/os/bluestore/BlueFS.cc: 172: FAILED assert(bdev[id]->get_size() >= offset + length) ceph version 12.2.0 (32ce2a3ae5239ee33d6150705cdb24d43bab910c) luminous (rc) 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x110) [0x7f463a362510] 2: (BlueFS::add_block_extent(unsigned int, unsigned long, unsigned long)+0x4d8) [0x7f463a2e7f88] 3: (BlueStore::_open_db(bool)+0xc4f) [0x7f463a20b97f] 4: (BlueStore::mkfs()+0xd0d) [0x7f463a21599d] 5: (OSD::mkfs(CephContext*, ObjectStore*, std::string const&, uuid_d, int)+0x29b) [0x7f4639dccf1b] 6: (main()+0xf42) [0x7f4639d0c972] 7: (__libc_start_main()+0xf5) [0x7f4635f45b35] 8: (()+0x4acb56) [0x7f4639dacb56] NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this. --- logging levels --- 0/ 5 none 0/ 1 lockdep 0/ 1 context 1/ 1 crush 1/ 5 mds 1/ 5 mds_balancer 1/ 5 mds_locker 1/ 5 mds_log 1/ 5 mds_log_expire 1/ 5 mds_migrator 0/ 1 buffer 0/ 1 timer 0/ 1 filer 0/ 1 striper 0/ 1 objecter 0/ 5 rados 0/ 5 rbd 0/ 5 rbd_mirror 0/ 5 rbd_replay 0/ 5 journaler 0/ 5 objectcacher 0/ 5 client 1/ 5 osd 0/ 5 optracker 0/ 5 objclass 1/ 3 filestore 1/ 3 journal 0/ 5 ms 1/ 5 mon 0/10 monc 1/ 5 paxos 0/ 5 tp 1/ 5 auth 1/ 5 crypto 1/ 1 finisher 1/ 5 heartbeatmap 1/ 5 perfcounter 1/ 5 rgw 1/10 civetweb 1/ 5 javaclient 1/ 5 asok 1/ 1 throttle 0/ 0 refs 1/ 5 xio 1/ 5 compressor 20/20 bluestore 1/ 5 bluefs 1/ 3 bdev 1/ 5 kstore 4/ 5 rocksdb 4/ 5 leveldb 4/ 5 memdb 1/ 5 kinetic 1/ 5 fuse 1/ 5 mgr 1/ 5 mgrc 1/ 5 dpdk 1/ 5 eventtrace -2/-2 (syslog threshold) -1/-1 (stderr threshold) max_recent 10000 max_new 1000 log_file /var/log/ceph/ceph-osd.0.log --- end dump of recent events --- 2017-08-31 23:05:32.192789 7f46398e5d00 -1 *** Caught signal (Aborted) ** in thread 7f46398e5d00 thread_name:ceph-osd ceph version 12.2.0 (32ce2a3ae5239ee33d6150705cdb24d43bab910c) luminous (rc) 1: (()+0xa23b21) [0x7f463a323b21] 2: (()+0xf370) [0x7f4636f2f370] 3: (gsignal()+0x37) [0x7f4635f591d7] 4: (abort()+0x148) [0x7f4635f5a8c8] 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x284) [0x7f463a362684] 6: (BlueFS::add_block_extent(unsigned int, unsigned long, unsigned long)+0x4d8) [0x7f463a2e7f88] 7: (BlueStore::_open_db(bool)+0xc4f) [0x7f463a20b97f] 8: (BlueStore::mkfs()+0xd0d) [0x7f463a21599d] 9: (OSD::mkfs(CephContext*, ObjectStore*, std::string const&, uuid_d, int)+0x29b) [0x7f4639dccf1b] 10: (main()+0xf42) [0x7f4639d0c972] 11: (__libc_start_main()+0xf5) [0x7f4635f45b35] 12: (()+0x4acb56) [0x7f4639dacb56] NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this. --- begin dump of recent events --- 0> 2017-08-31 23:05:32.192789 7f46398e5d00 -1 *** Caught signal (Aborted) ** in thread 7f46398e5d00 thread_name:ceph-osd ceph version 12.2.0 (32ce2a3ae5239ee33d6150705cdb24d43bab910c) luminous (rc) 1: (()+0xa23b21) [0x7f463a323b21] 2: (()+0xf370) [0x7f4636f2f370] 3: (gsignal()+0x37) [0x7f4635f591d7] 4: (abort()+0x148) [0x7f4635f5a8c8] 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x284) [0x7f463a362684] 6: (BlueFS::add_block_extent(unsigned int, unsigned long, unsigned long)+0x4d8) [0x7f463a2e7f88] 7: (BlueStore::_open_db(bool)+0xc4f) [0x7f463a20b97f] 8: (BlueStore::mkfs()+0xd0d) [0x7f463a21599d] 9: (OSD::mkfs(CephContext*, ObjectStore*, std::string const&, uuid_d, int)+0x29b) [0x7f4639dccf1b] 10: (main()+0xf42) [0x7f4639d0c972] 11: (__libc_start_main()+0xf5) [0x7f4635f45b35] 12: (()+0x4acb56) [0x7f4639dacb56] NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this. --- logging levels --- 0/ 5 none 0/ 1 lockdep 0/ 1 context 1/ 1 crush 1/ 5 mds 1/ 5 mds_balancer 1/ 5 mds_locker 1/ 5 mds_log 1/ 5 mds_log_expire 1/ 5 mds_migrator 0/ 1 buffer 0/ 1 timer 0/ 1 filer 0/ 1 striper 0/ 1 objecter 0/ 5 rados 0/ 5 rbd 0/ 5 rbd_mirror 0/ 5 rbd_replay 0/ 5 journaler 0/ 5 objectcacher 0/ 5 client 1/ 5 osd 0/ 5 optracker 0/ 5 objclass 1/ 3 filestore 1/ 3 journal 0/ 5 ms 1/ 5 mon 0/10 monc 1/ 5 paxos 0/ 5 tp 1/ 5 auth 1/ 5 crypto 1/ 1 finisher 1/ 5 heartbeatmap 1/ 5 perfcounter 1/ 5 rgw 1/10 civetweb 1/ 5 javaclient 1/ 5 asok 1/ 1 throttle 0/ 0 refs 1/ 5 xio 1/ 5 compressor 20/20 bluestore 1/ 5 bluefs 1/ 3 bdev 1/ 5 kstore 4/ 5 rocksdb 4/ 5 leveldb 4/ 5 memdb 1/ 5 kinetic 1/ 5 fuse 1/ 5 mgr 1/ 5 mgrc 1/ 5 dpdk 1/ 5 eventtrace -2/-2 (syslog threshold) -1/-1 (stderr threshold) max_recent 10000 max_new 1000 log_file /var/log/ceph/ceph-osd.0.log --- end dump of recent events --- 2017-08-31 23:05:32.579207 7f0bcf556d00 0 set uid:gid to 1001:1001 (ceph:ceph) 2017-08-31 23:05:32.579223 7f0bcf556d00 0 ceph version 12.2.0 (32ce2a3ae5239ee33d6150705cdb24d43bab910c) luminous (rc), process (unknown), pid 7193 2017-08-31 23:05:32.579366 7f0bcf556d00 10 bluestore(/var/lib/ceph/tmp/mnt.7MmJ48) set_cache_shards 1 2017-08-31 23:05:32.596184 7f0bcf556d00 10 bluestore(/var/lib/ceph/tmp/mnt.7MmJ48) _set_csum csum_type crc32c 2017-08-31 23:05:32.597060 7f0bcf556d00 1 bluestore(/var/lib/ceph/tmp/mnt.7MmJ48) mkfs path /var/lib/ceph/tmp/mnt.7MmJ48 2017-08-31 23:05:32.597097 7f0bcf556d00 20 bluestore(/var/lib/ceph/tmp/mnt.7MmJ48) _setup_block_symlink_or_file name block path size 10737418240 create=1 2017-08-31 23:05:32.597182 7f0bcf556d00 20 bluestore(/var/lib/ceph/tmp/mnt.7MmJ48) _setup_block_symlink_or_file name block.wal path size 100663296 create=0 2017-08-31 23:05:32.597186 7f0bcf556d00 20 bluestore(/var/lib/ceph/tmp/mnt.7MmJ48) _setup_block_symlink_or_file name block.db path size 0 create=0 2017-08-31 23:05:32.597198 7f0bcf556d00 1 bdev create path /var/lib/ceph/tmp/mnt.7MmJ48/block type kernel 2017-08-31 23:05:32.597202 7f0bcf556d00 1 bdev(0x7f0bdb258800 /var/lib/ceph/tmp/mnt.7MmJ48/block) open path /var/lib/ceph/tmp/mnt.7MmJ48/block 2017-08-31 23:05:32.597420 7f0bcf556d00 1 bdev(0x7f0bdb258800 /var/lib/ceph/tmp/mnt.7MmJ48/block) open size 28291072 (0x1afb000, 27628 kB) block_size 4096 (4096 B) rotational 2017-08-31 23:05:32.597431 7f0bcf556d00 10 bluestore(/var/lib/ceph/tmp/mnt.7MmJ48/block) _write_bdev_label path /var/lib/ceph/tmp/mnt.7MmJ48/block label bdev(osd_uuid 55ffcfe9-cc63-49ef-9ef7-383999d8627b size 0x1afb000 btime 2017-08-31 23:05:32.597430 desc main) 2017-08-31 23:05:32.597477 7f0bcf556d00 1 bluestore(/var/lib/ceph/tmp/mnt.7MmJ48) _set_cache_sizes max 0.5 < ratio 0.99 2017-08-31 23:05:32.597495 7f0bcf556d00 1 bluestore(/var/lib/ceph/tmp/mnt.7MmJ48) _set_cache_sizes cache_size 1073741824 meta 0.5 kv 0.5 data 0 2017-08-31 23:05:32.597502 7f0bcf556d00 10 bluestore(/var/lib/ceph/tmp/mnt.7MmJ48) _open_db kv_backend = rocksdb 2017-08-31 23:05:32.597503 7f0bcf556d00 10 bluestore(/var/lib/ceph/tmp/mnt.7MmJ48) _open_db do_bluefs = 1 2017-08-31 23:05:32.597503 7f0bcf556d00 10 bluestore(/var/lib/ceph/tmp/mnt.7MmJ48) _open_db initializing bluefs 2017-08-31 23:05:32.597520 7f0bcf556d00 1 bdev create path /var/lib/ceph/tmp/mnt.7MmJ48/block type kernel 2017-08-31 23:05:32.597521 7f0bcf556d00 1 bdev(0x7f0bdb4e9000 /var/lib/ceph/tmp/mnt.7MmJ48/block) open path /var/lib/ceph/tmp/mnt.7MmJ48/block 2017-08-31 23:05:32.597608 7f0bcf556d00 1 bdev(0x7f0bdb4e9000 /var/lib/ceph/tmp/mnt.7MmJ48/block) open size 28291072 (0x1afb000, 27628 kB) block_size 4096 (4096 B) rotational 2017-08-31 23:05:32.597612 7f0bcf556d00 1 bluefs add_block_device bdev 1 path /var/lib/ceph/tmp/mnt.7MmJ48/block size 27628 kB 2017-08-31 23:05:32.597616 7f0bcf556d00 1 bluefs add_block_extent bdev 1 0x7fffffffe0d00000~40000000 2017-08-31 23:05:32.599925 7f0bcf556d00 -1 /home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/12.2.0/rpm/el7/BUILD/ceph-12.2.0/src/os/bluestore/BlueFS.cc: In function 'void BlueFS::add_block_extent(unsigned int, uint64_t, uint64_t)' thread 7f0bcf556d00 time 2017-08-31 23:05:32.597617 /home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/12.2.0/rpm/el7/BUILD/ceph-12.2.0/src/os/bluestore/BlueFS.cc: 172: FAILED assert(bdev[id]->get_size() >= offset + length) ceph version 12.2.0 (32ce2a3ae5239ee33d6150705cdb24d43bab910c) luminous (rc) 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x110) [0x7f0bcffd3510] 2: (BlueFS::add_block_extent(unsigned int, unsigned long, unsigned long)+0x4d8) [0x7f0bcff58f88] 3: (BlueStore::_open_db(bool)+0xc4f) [0x7f0bcfe7c97f] 4: (BlueStore::mkfs()+0xd0d) [0x7f0bcfe8699d] 5: (OSD::mkfs(CephContext*, ObjectStore*, std::string const&, uuid_d, int)+0x29b) [0x7f0bcfa3df1b] 6: (main()+0xf42) [0x7f0bcf97d972] 7: (__libc_start_main()+0xf5) [0x7f0bcbbb6b35] 8: (()+0x4acb56) [0x7f0bcfa1db56] NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this. --- begin dump of recent events --- -63> 2017-08-31 23:05:32.572491 7f0bcf556d00 5 asok(0x7f0bdb26e1c0) register_command perfcounters_dump hook 0x7f0bdb216190 -62> 2017-08-31 23:05:32.572504 7f0bcf556d00 5 asok(0x7f0bdb26e1c0) register_command 1 hook 0x7f0bdb216190 -61> 2017-08-31 23:05:32.572507 7f0bcf556d00 5 asok(0x7f0bdb26e1c0) register_command perf dump hook 0x7f0bdb216190 -60> 2017-08-31 23:05:32.572508 7f0bcf556d00 5 asok(0x7f0bdb26e1c0) register_command perfcounters_schema hook 0x7f0bdb216190 -59> 2017-08-31 23:05:32.572510 7f0bcf556d00 5 asok(0x7f0bdb26e1c0) register_command perf histogram dump hook 0x7f0bdb216190 -58> 2017-08-31 23:05:32.572511 7f0bcf556d00 5 asok(0x7f0bdb26e1c0) register_command 2 hook 0x7f0bdb216190 -57> 2017-08-31 23:05:32.572512 7f0bcf556d00 5 asok(0x7f0bdb26e1c0) register_command perf schema hook 0x7f0bdb216190 -56> 2017-08-31 23:05:32.572514 7f0bcf556d00 5 asok(0x7f0bdb26e1c0) register_command perf histogram schema hook 0x7f0bdb216190 -55> 2017-08-31 23:05:32.572515 7f0bcf556d00 5 asok(0x7f0bdb26e1c0) register_command perf reset hook 0x7f0bdb216190 -54> 2017-08-31 23:05:32.572517 7f0bcf556d00 5 asok(0x7f0bdb26e1c0) register_command config show hook 0x7f0bdb216190 -53> 2017-08-31 23:05:32.572518 7f0bcf556d00 5 asok(0x7f0bdb26e1c0) register_command config help hook 0x7f0bdb216190 -52> 2017-08-31 23:05:32.572520 7f0bcf556d00 5 asok(0x7f0bdb26e1c0) register_command config set hook 0x7f0bdb216190 -51> 2017-08-31 23:05:32.572522 7f0bcf556d00 5 asok(0x7f0bdb26e1c0) register_command config get hook 0x7f0bdb216190 -50> 2017-08-31 23:05:32.572528 7f0bcf556d00 5 asok(0x7f0bdb26e1c0) register_command config diff hook 0x7f0bdb216190 -49> 2017-08-31 23:05:32.572531 7f0bcf556d00 5 asok(0x7f0bdb26e1c0) register_command config diff get hook 0x7f0bdb216190 -48> 2017-08-31 23:05:32.572533 7f0bcf556d00 5 asok(0x7f0bdb26e1c0) register_command log flush hook 0x7f0bdb216190 -47> 2017-08-31 23:05:32.572534 7f0bcf556d00 5 asok(0x7f0bdb26e1c0) register_command log dump hook 0x7f0bdb216190 -46> 2017-08-31 23:05:32.572536 7f0bcf556d00 5 asok(0x7f0bdb26e1c0) register_command log reopen hook 0x7f0bdb216190 -45> 2017-08-31 23:05:32.572541 7f0bcf556d00 5 asok(0x7f0bdb26e1c0) register_command dump_mempools hook 0x7f0bdb3edb08 -44> 2017-08-31 23:05:32.579207 7f0bcf556d00 0 set uid:gid to 1001:1001 (ceph:ceph) -43> 2017-08-31 23:05:32.579223 7f0bcf556d00 0 ceph version 12.2.0 (32ce2a3ae5239ee33d6150705cdb24d43bab910c) luminous (rc), process (unknown), pid 7193 -42> 2017-08-31 23:05:32.579263 7f0bcf556d00 5 object store type is bluestore -41> 2017-08-31 23:05:32.579366 7f0bcf556d00 10 bluestore(/var/lib/ceph/tmp/mnt.7MmJ48) set_cache_shards 1 -40> 2017-08-31 23:05:32.596184 7f0bcf556d00 10 bluestore(/var/lib/ceph/tmp/mnt.7MmJ48) _set_csum csum_type crc32c -39> 2017-08-31 23:05:32.596196 7f0bcf556d00 5 asok(0x7f0bdb26e1c0) init /var/run/ceph/ceph-osd.0.asok -38> 2017-08-31 23:05:32.596210 7f0bcf556d00 5 asok(0x7f0bdb26e1c0) bind_and_listen /var/run/ceph/ceph-osd.0.asok -37> 2017-08-31 23:05:32.596348 7f0bcf556d00 5 asok(0x7f0bdb26e1c0) register_command 0 hook 0x7f0bdb212180 -36> 2017-08-31 23:05:32.596353 7f0bcf556d00 5 asok(0x7f0bdb26e1c0) register_command version hook 0x7f0bdb212180 -35> 2017-08-31 23:05:32.596355 7f0bcf556d00 5 asok(0x7f0bdb26e1c0) register_command git_version hook 0x7f0bdb212180 -34> 2017-08-31 23:05:32.596357 7f0bcf556d00 5 asok(0x7f0bdb26e1c0) register_command help hook 0x7f0bdb216290 -33> 2017-08-31 23:05:32.596359 7f0bcf556d00 5 asok(0x7f0bdb26e1c0) register_command get_command_descriptions hook 0x7f0bdb2162a0 -32> 2017-08-31 23:05:32.596395 7f0bcf556d00 10 monclient: build_initial_monmap -31> 2017-08-31 23:05:32.596438 7f0bcf556d00 10 monclient: get_monmap_privately -30> 2017-08-31 23:05:32.596772 7f0bc9134700 5 asok(0x7f0bdb26e1c0) entry start -29> 2017-08-31 23:05:32.596789 7f0bc8933700 2 Event(0x7f0bdb258e80 nevent=5000 time_id=1).set_owner idx=0 owner=139688586458880 -28> 2017-08-31 23:05:32.596815 7f0bc8132700 2 Event(0x7f0bdb259480 nevent=5000 time_id=1).set_owner idx=1 owner=139688578066176 -27> 2017-08-31 23:05:32.596828 7f0bc7931700 2 Event(0x7f0bdb258c80 nevent=5000 time_id=1).set_owner idx=2 owner=139688569673472 -26> 2017-08-31 23:05:32.596855 7f0bcf556d00 1 Processor -- start -25> 2017-08-31 23:05:32.596883 7f0bcf556d00 1 -- - start start -24> 2017-08-31 23:05:32.596886 7f0bcf556d00 10 monclient: have 1 fsid cbc93c9d-f4ee-4039-b738-c09cb52bff9c -23> 2017-08-31 23:05:32.596904 7f0bcf556d00 1 -- - shutdown_connections -22> 2017-08-31 23:05:32.596985 7f0bcf556d00 1 -- - shutdown_connections -21> 2017-08-31 23:05:32.597016 7f0bcf556d00 1 -- - wait complete. -20> 2017-08-31 23:05:32.597021 7f0bcf556d00 1 -- - >> - conn(0x7f0bdb5ba000 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down -19> 2017-08-31 23:05:32.597028 7f0bcf556d00 2 -- - >> - conn(0x7f0bdb5ba000 :-1 s=STATE_NONE pgs=0 cs=0 l=0)._stop -18> 2017-08-31 23:05:32.597060 7f0bcf556d00 1 bluestore(/var/lib/ceph/tmp/mnt.7MmJ48) mkfs path /var/lib/ceph/tmp/mnt.7MmJ48 -17> 2017-08-31 23:05:32.597097 7f0bcf556d00 20 bluestore(/var/lib/ceph/tmp/mnt.7MmJ48) _setup_block_symlink_or_file name block path size 10737418240 create=1 -16> 2017-08-31 23:05:32.597182 7f0bcf556d00 20 bluestore(/var/lib/ceph/tmp/mnt.7MmJ48) _setup_block_symlink_or_file name block.wal path size 100663296 create=0 -15> 2017-08-31 23:05:32.597186 7f0bcf556d00 20 bluestore(/var/lib/ceph/tmp/mnt.7MmJ48) _setup_block_symlink_or_file name block.db path size 0 create=0 -14> 2017-08-31 23:05:32.597198 7f0bcf556d00 1 bdev create path /var/lib/ceph/tmp/mnt.7MmJ48/block type kernel -13> 2017-08-31 23:05:32.597202 7f0bcf556d00 1 bdev(0x7f0bdb258800 /var/lib/ceph/tmp/mnt.7MmJ48/block) open path /var/lib/ceph/tmp/mnt.7MmJ48/block -12> 2017-08-31 23:05:32.597420 7f0bcf556d00 1 bdev(0x7f0bdb258800 /var/lib/ceph/tmp/mnt.7MmJ48/block) open size 28291072 (0x1afb000, 27628 kB) block_size 4096 (4096 B) rotational -11> 2017-08-31 23:05:32.597431 7f0bcf556d00 10 bluestore(/var/lib/ceph/tmp/mnt.7MmJ48/block) _write_bdev_label path /var/lib/ceph/tmp/mnt.7MmJ48/block label bdev(osd_uuid 55ffcfe9-cc63-49ef-9ef7-383999d8627b size 0x1afb000 btime 2017-08-31 23:05:32.597430 desc main) -10> 2017-08-31 23:05:32.597477 7f0bcf556d00 1 bluestore(/var/lib/ceph/tmp/mnt.7MmJ48) _set_cache_sizes max 0.5 < ratio 0.99 -9> 2017-08-31 23:05:32.597495 7f0bcf556d00 1 bluestore(/var/lib/ceph/tmp/mnt.7MmJ48) _set_cache_sizes cache_size 1073741824 meta 0.5 kv 0.5 data 0 -8> 2017-08-31 23:05:32.597502 7f0bcf556d00 10 bluestore(/var/lib/ceph/tmp/mnt.7MmJ48) _open_db kv_backend = rocksdb -7> 2017-08-31 23:05:32.597503 7f0bcf556d00 10 bluestore(/var/lib/ceph/tmp/mnt.7MmJ48) _open_db do_bluefs = 1 -6> 2017-08-31 23:05:32.597503 7f0bcf556d00 10 bluestore(/var/lib/ceph/tmp/mnt.7MmJ48) _open_db initializing bluefs -5> 2017-08-31 23:05:32.597520 7f0bcf556d00 1 bdev create path /var/lib/ceph/tmp/mnt.7MmJ48/block type kernel -4> 2017-08-31 23:05:32.597521 7f0bcf556d00 1 bdev(0x7f0bdb4e9000 /var/lib/ceph/tmp/mnt.7MmJ48/block) open path /var/lib/ceph/tmp/mnt.7MmJ48/block -3> 2017-08-31 23:05:32.597608 7f0bcf556d00 1 bdev(0x7f0bdb4e9000 /var/lib/ceph/tmp/mnt.7MmJ48/block) open size 28291072 (0x1afb000, 27628 kB) block_size 4096 (4096 B) rotational -2> 2017-08-31 23:05:32.597612 7f0bcf556d00 1 bluefs add_block_device bdev 1 path /var/lib/ceph/tmp/mnt.7MmJ48/block size 27628 kB -1> 2017-08-31 23:05:32.597616 7f0bcf556d00 1 bluefs add_block_extent bdev 1 0x7fffffffe0d00000~40000000 0> 2017-08-31 23:05:32.599925 7f0bcf556d00 -1 /home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/12.2.0/rpm/el7/BUILD/ceph-12.2.0/src/os/bluestore/BlueFS.cc: In function 'void BlueFS::add_block_extent(unsigned int, uint64_t, uint64_t)' thread 7f0bcf556d00 time 2017-08-31 23:05:32.597617 /home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/12.2.0/rpm/el7/BUILD/ceph-12.2.0/src/os/bluestore/BlueFS.cc: 172: FAILED assert(bdev[id]->get_size() >= offset + length) ceph version 12.2.0 (32ce2a3ae5239ee33d6150705cdb24d43bab910c) luminous (rc) 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x110) [0x7f0bcffd3510] 2: (BlueFS::add_block_extent(unsigned int, unsigned long, unsigned long)+0x4d8) [0x7f0bcff58f88] 3: (BlueStore::_open_db(bool)+0xc4f) [0x7f0bcfe7c97f] 4: (BlueStore::mkfs()+0xd0d) [0x7f0bcfe8699d] 5: (OSD::mkfs(CephContext*, ObjectStore*, std::string const&, uuid_d, int)+0x29b) [0x7f0bcfa3df1b] 6: (main()+0xf42) [0x7f0bcf97d972] 7: (__libc_start_main()+0xf5) [0x7f0bcbbb6b35] 8: (()+0x4acb56) [0x7f0bcfa1db56] NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this. --- logging levels --- 0/ 5 none 0/ 1 lockdep 0/ 1 context 1/ 1 crush 1/ 5 mds 1/ 5 mds_balancer 1/ 5 mds_locker 1/ 5 mds_log 1/ 5 mds_log_expire 1/ 5 mds_migrator 0/ 1 buffer 0/ 1 timer 0/ 1 filer 0/ 1 striper 0/ 1 objecter 0/ 5 rados 0/ 5 rbd 0/ 5 rbd_mirror 0/ 5 rbd_replay 0/ 5 journaler 0/ 5 objectcacher 0/ 5 client 1/ 5 osd 0/ 5 optracker 0/ 5 objclass 1/ 3 filestore 1/ 3 journal 0/ 5 ms 1/ 5 mon 0/10 monc 1/ 5 paxos 0/ 5 tp 1/ 5 auth 1/ 5 crypto 1/ 1 finisher 1/ 5 heartbeatmap 1/ 5 perfcounter 1/ 5 rgw 1/10 civetweb 1/ 5 javaclient 1/ 5 asok 1/ 1 throttle 0/ 0 refs 1/ 5 xio 1/ 5 compressor 20/20 bluestore 1/ 5 bluefs 1/ 3 bdev 1/ 5 kstore 4/ 5 rocksdb 4/ 5 leveldb 4/ 5 memdb 1/ 5 kinetic 1/ 5 fuse 1/ 5 mgr 1/ 5 mgrc 1/ 5 dpdk 1/ 5 eventtrace -2/-2 (syslog threshold) -1/-1 (stderr threshold) max_recent 10000 max_new 1000 log_file /var/log/ceph/ceph-osd.0.log --- end dump of recent events --- 2017-08-31 23:05:32.602290 7f0bcf556d00 -1 *** Caught signal (Aborted) ** in thread 7f0bcf556d00 thread_name:ceph-osd ceph version 12.2.0 (32ce2a3ae5239ee33d6150705cdb24d43bab910c) luminous (rc) 1: (()+0xa23b21) [0x7f0bcff94b21] 2: (()+0xf370) [0x7f0bccba0370] 3: (gsignal()+0x37) [0x7f0bcbbca1d7] 4: (abort()+0x148) [0x7f0bcbbcb8c8] 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x284) [0x7f0bcffd3684] 6: (BlueFS::add_block_extent(unsigned int, unsigned long, unsigned long)+0x4d8) [0x7f0bcff58f88] 7: (BlueStore::_open_db(bool)+0xc4f) [0x7f0bcfe7c97f] 8: (BlueStore::mkfs()+0xd0d) [0x7f0bcfe8699d] 9: (OSD::mkfs(CephContext*, ObjectStore*, std::string const&, uuid_d, int)+0x29b) [0x7f0bcfa3df1b] 10: (main()+0xf42) [0x7f0bcf97d972] 11: (__libc_start_main()+0xf5) [0x7f0bcbbb6b35] 12: (()+0x4acb56) [0x7f0bcfa1db56] NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this. --- begin dump of recent events --- 0> 2017-08-31 23:05:32.602290 7f0bcf556d00 -1 *** Caught signal (Aborted) ** in thread 7f0bcf556d00 thread_name:ceph-osd ceph version 12.2.0 (32ce2a3ae5239ee33d6150705cdb24d43bab910c) luminous (rc) 1: (()+0xa23b21) [0x7f0bcff94b21] 2: (()+0xf370) [0x7f0bccba0370] 3: (gsignal()+0x37) [0x7f0bcbbca1d7] 4: (abort()+0x148) [0x7f0bcbbcb8c8] 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x284) [0x7f0bcffd3684] 6: (BlueFS::add_block_extent(unsigned int, unsigned long, unsigned long)+0x4d8) [0x7f0bcff58f88] 7: (BlueStore::_open_db(bool)+0xc4f) [0x7f0bcfe7c97f] 8: (BlueStore::mkfs()+0xd0d) [0x7f0bcfe8699d] 9: (OSD::mkfs(CephContext*, ObjectStore*, std::string const&, uuid_d, int)+0x29b) [0x7f0bcfa3df1b] 10: (main()+0xf42) [0x7f0bcf97d972] 11: (__libc_start_main()+0xf5) [0x7f0bcbbb6b35] 12: (()+0x4acb56) [0x7f0bcfa1db56] NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this. --- logging levels --- 0/ 5 none 0/ 1 lockdep 0/ 1 context 1/ 1 crush 1/ 5 mds 1/ 5 mds_balancer 1/ 5 mds_locker 1/ 5 mds_log 1/ 5 mds_log_expire 1/ 5 mds_migrator 0/ 1 buffer 0/ 1 timer 0/ 1 filer 0/ 1 striper 0/ 1 objecter 0/ 5 rados 0/ 5 rbd 0/ 5 rbd_mirror 0/ 5 rbd_replay 0/ 5 journaler 0/ 5 objectcacher 0/ 5 client 1/ 5 osd 0/ 5 optracker 0/ 5 objclass 1/ 3 filestore 1/ 3 journal 0/ 5 ms 1/ 5 mon 0/10 monc 1/ 5 paxos 0/ 5 tp 1/ 5 auth 1/ 5 crypto 1/ 1 finisher 1/ 5 heartbeatmap 1/ 5 perfcounter 1/ 5 rgw 1/10 civetweb 1/ 5 javaclient 1/ 5 asok 1/ 1 throttle 0/ 0 refs 1/ 5 xio 1/ 5 compressor 20/20 bluestore 1/ 5 bluefs 1/ 3 bdev 1/ 5 kstore 4/ 5 rocksdb 4/ 5 leveldb 4/ 5 memdb 1/ 5 kinetic 1/ 5 fuse 1/ 5 mgr 1/ 5 mgrc 1/ 5 dpdk 1/ 5 eventtrace -2/-2 (syslog threshold) -1/-1 (stderr threshold) max_recent 10000 max_new 1000 log_file /var/log/ceph/ceph-osd.0.log --- end dump of recent events --- 2017-08-31 23:06:03.224263 7fc53c812d00 0 set uid:gid to 1001:1001 (ceph:ceph) 2017-08-31 23:06:03.224281 7fc53c812d00 0 ceph version 12.2.0 (32ce2a3ae5239ee33d6150705cdb24d43bab910c) luminous (rc), process (unknown), pid 7361 2017-08-31 23:06:03.224474 7fc53c812d00 10 bluestore(/var/lib/ceph/tmp/mnt.3x9YTJ) set_cache_shards 1 2017-08-31 23:06:03.242816 7fc53c812d00 10 bluestore(/var/lib/ceph/tmp/mnt.3x9YTJ) _set_csum csum_type crc32c 2017-08-31 23:06:03.244989 7fc53c812d00 1 bluestore(/var/lib/ceph/tmp/mnt.3x9YTJ) mkfs path /var/lib/ceph/tmp/mnt.3x9YTJ 2017-08-31 23:06:03.245053 7fc53c812d00 20 bluestore(/var/lib/ceph/tmp/mnt.3x9YTJ) _setup_block_symlink_or_file name block path size 10737418240 create=1 2017-08-31 23:06:03.245488 7fc53c812d00 20 bluestore(/var/lib/ceph/tmp/mnt.3x9YTJ) _setup_block_symlink_or_file name block.wal path size 100663296 create=0 2017-08-31 23:06:03.245505 7fc53c812d00 20 bluestore(/var/lib/ceph/tmp/mnt.3x9YTJ) _setup_block_symlink_or_file name block.db path size 0 create=0 2017-08-31 23:06:03.245540 7fc53c812d00 1 bdev create path /var/lib/ceph/tmp/mnt.3x9YTJ/block type kernel 2017-08-31 23:06:03.245550 7fc53c812d00 1 bdev(0x7fc547c40800 /var/lib/ceph/tmp/mnt.3x9YTJ/block) open path /var/lib/ceph/tmp/mnt.3x9YTJ/block 2017-08-31 23:06:03.246052 7fc53c812d00 1 bdev(0x7fc547c40800 /var/lib/ceph/tmp/mnt.3x9YTJ/block) open size 28291072 (0x1afb000, 27628 kB) block_size 4096 (4096 B) rotational 2017-08-31 23:06:03.246073 7fc53c812d00 10 bluestore(/var/lib/ceph/tmp/mnt.3x9YTJ/block) _write_bdev_label path /var/lib/ceph/tmp/mnt.3x9YTJ/block label bdev(osd_uuid 55ffcfe9-cc63-49ef-9ef7-383999d8627b size 0x1afb000 btime 2017-08-31 23:06:03.246071 desc main) 2017-08-31 23:06:03.246160 7fc53c812d00 1 bluestore(/var/lib/ceph/tmp/mnt.3x9YTJ) _set_cache_sizes max 0.5 < ratio 0.99 2017-08-31 23:06:03.246180 7fc53c812d00 1 bluestore(/var/lib/ceph/tmp/mnt.3x9YTJ) _set_cache_sizes cache_size 1073741824 meta 0.5 kv 0.5 data 0 2017-08-31 23:06:03.246188 7fc53c812d00 10 bluestore(/var/lib/ceph/tmp/mnt.3x9YTJ) _open_db kv_backend = rocksdb 2017-08-31 23:06:03.246188 7fc53c812d00 10 bluestore(/var/lib/ceph/tmp/mnt.3x9YTJ) _open_db do_bluefs = 1 2017-08-31 23:06:03.246189 7fc53c812d00 10 bluestore(/var/lib/ceph/tmp/mnt.3x9YTJ) _open_db initializing bluefs 2017-08-31 23:06:03.246208 7fc53c812d00 1 bdev create path /var/lib/ceph/tmp/mnt.3x9YTJ/block type kernel 2017-08-31 23:06:03.246210 7fc53c812d00 1 bdev(0x7fc547ed1000 /var/lib/ceph/tmp/mnt.3x9YTJ/block) open path /var/lib/ceph/tmp/mnt.3x9YTJ/block 2017-08-31 23:06:03.246309 7fc53c812d00 1 bdev(0x7fc547ed1000 /var/lib/ceph/tmp/mnt.3x9YTJ/block) open size 28291072 (0x1afb000, 27628 kB) block_size 4096 (4096 B) rotational 2017-08-31 23:06:03.246314 7fc53c812d00 1 bluefs add_block_device bdev 1 path /var/lib/ceph/tmp/mnt.3x9YTJ/block size 27628 kB 2017-08-31 23:06:03.246318 7fc53c812d00 1 bluefs add_block_extent bdev 1 0x7fffffffe0d00000~40000000 2017-08-31 23:06:03.248558 7fc53c812d00 -1 /home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/12.2.0/rpm/el7/BUILD/ceph-12.2.0/src/os/bluestore/BlueFS.cc: In function 'void BlueFS::add_block_extent(unsigned int, uint64_t, uint64_t)' thread 7fc53c812d00 time 2017-08-31 23:06:03.246319 /home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/12.2.0/rpm/el7/BUILD/ceph-12.2.0/src/os/bluestore/BlueFS.cc: 172: FAILED assert(bdev[id]->get_size() >= offset + length) ceph version 12.2.0 (32ce2a3ae5239ee33d6150705cdb24d43bab910c) luminous (rc) 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x110) [0x7fc53d28f510] 2: (BlueFS::add_block_extent(unsigned int, unsigned long, unsigned long)+0x4d8) [0x7fc53d214f88] 3: (BlueStore::_open_db(bool)+0xc4f) [0x7fc53d13897f] 4: (BlueStore::mkfs()+0xd0d) [0x7fc53d14299d] 5: (OSD::mkfs(CephContext*, ObjectStore*, std::string const&, uuid_d, int)+0x29b) [0x7fc53ccf9f1b] 6: (main()+0xf42) [0x7fc53cc39972] 7: (__libc_start_main()+0xf5) [0x7fc538e72b35] 8: (()+0x4acb56) [0x7fc53ccd9b56] NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this. --- begin dump of recent events --- -63> 2017-08-31 23:06:03.217026 7fc53c812d00 5 asok(0x7fc547c561c0) register_command perfcounters_dump hook 0x7fc547bfe190 -62> 2017-08-31 23:06:03.217040 7fc53c812d00 5 asok(0x7fc547c561c0) register_command 1 hook 0x7fc547bfe190 -61> 2017-08-31 23:06:03.217042 7fc53c812d00 5 asok(0x7fc547c561c0) register_command perf dump hook 0x7fc547bfe190 -60> 2017-08-31 23:06:03.217044 7fc53c812d00 5 asok(0x7fc547c561c0) register_command perfcounters_schema hook 0x7fc547bfe190 -59> 2017-08-31 23:06:03.217045 7fc53c812d00 5 asok(0x7fc547c561c0) register_command perf histogram dump hook 0x7fc547bfe190 -58> 2017-08-31 23:06:03.217047 7fc53c812d00 5 asok(0x7fc547c561c0) register_command 2 hook 0x7fc547bfe190 -57> 2017-08-31 23:06:03.217048 7fc53c812d00 5 asok(0x7fc547c561c0) register_command perf schema hook 0x7fc547bfe190 -56> 2017-08-31 23:06:03.217050 7fc53c812d00 5 asok(0x7fc547c561c0) register_command perf histogram schema hook 0x7fc547bfe190 -55> 2017-08-31 23:06:03.217051 7fc53c812d00 5 asok(0x7fc547c561c0) register_command perf reset hook 0x7fc547bfe190 -54> 2017-08-31 23:06:03.217053 7fc53c812d00 5 asok(0x7fc547c561c0) register_command config show hook 0x7fc547bfe190 -53> 2017-08-31 23:06:03.217054 7fc53c812d00 5 asok(0x7fc547c561c0) register_command config help hook 0x7fc547bfe190 -52> 2017-08-31 23:06:03.217056 7fc53c812d00 5 asok(0x7fc547c561c0) register_command config set hook 0x7fc547bfe190 -51> 2017-08-31 23:06:03.217058 7fc53c812d00 5 asok(0x7fc547c561c0) register_command config get hook 0x7fc547bfe190 -50> 2017-08-31 23:06:03.217059 7fc53c812d00 5 asok(0x7fc547c561c0) register_command config diff hook 0x7fc547bfe190 -49> 2017-08-31 23:06:03.217067 7fc53c812d00 5 asok(0x7fc547c561c0) register_command config diff get hook 0x7fc547bfe190 -48> 2017-08-31 23:06:03.217069 7fc53c812d00 5 asok(0x7fc547c561c0) register_command log flush hook 0x7fc547bfe190 -47> 2017-08-31 23:06:03.217070 7fc53c812d00 5 asok(0x7fc547c561c0) register_command log dump hook 0x7fc547bfe190 -46> 2017-08-31 23:06:03.217071 7fc53c812d00 5 asok(0x7fc547c561c0) register_command log reopen hook 0x7fc547bfe190 -45> 2017-08-31 23:06:03.217077 7fc53c812d00 5 asok(0x7fc547c561c0) register_command dump_mempools hook 0x7fc547dd5b08 -44> 2017-08-31 23:06:03.224263 7fc53c812d00 0 set uid:gid to 1001:1001 (ceph:ceph) -43> 2017-08-31 23:06:03.224281 7fc53c812d00 0 ceph version 12.2.0 (32ce2a3ae5239ee33d6150705cdb24d43bab910c) luminous (rc), process (unknown), pid 7361 -42> 2017-08-31 23:06:03.224323 7fc53c812d00 5 object store type is bluestore -41> 2017-08-31 23:06:03.224474 7fc53c812d00 10 bluestore(/var/lib/ceph/tmp/mnt.3x9YTJ) set_cache_shards 1 -40> 2017-08-31 23:06:03.242816 7fc53c812d00 10 bluestore(/var/lib/ceph/tmp/mnt.3x9YTJ) _set_csum csum_type crc32c -39> 2017-08-31 23:06:03.242834 7fc53c812d00 5 asok(0x7fc547c561c0) init /var/run/ceph/ceph-osd.0.asok -38> 2017-08-31 23:06:03.242854 7fc53c812d00 5 asok(0x7fc547c561c0) bind_and_listen /var/run/ceph/ceph-osd.0.asok -37> 2017-08-31 23:06:03.243320 7fc53c812d00 5 asok(0x7fc547c561c0) register_command 0 hook 0x7fc547bfa180 -36> 2017-08-31 23:06:03.243325 7fc53c812d00 5 asok(0x7fc547c561c0) register_command version hook 0x7fc547bfa180 -35> 2017-08-31 23:06:03.243327 7fc53c812d00 5 asok(0x7fc547c561c0) register_command git_version hook 0x7fc547bfa180 -34> 2017-08-31 23:06:03.243329 7fc53c812d00 5 asok(0x7fc547c561c0) register_command help hook 0x7fc547bfe290 -33> 2017-08-31 23:06:03.243331 7fc53c812d00 5 asok(0x7fc547c561c0) register_command get_command_descriptions hook 0x7fc547bfe2a0 -32> 2017-08-31 23:06:03.243383 7fc53c812d00 10 monclient: build_initial_monmap -31> 2017-08-31 23:06:03.243428 7fc53c812d00 10 monclient: get_monmap_privately -30> 2017-08-31 23:06:03.244203 7fc5353ee700 2 Event(0x7fc547c41480 nevent=5000 time_id=1).set_owner idx=1 owner=140484978599680 -29> 2017-08-31 23:06:03.244261 7fc534bed700 2 Event(0x7fc547c40c80 nevent=5000 time_id=1).set_owner idx=2 owner=140484970206976 -28> 2017-08-31 23:06:03.244277 7fc5363f0700 5 asok(0x7fc547c561c0) entry start -27> 2017-08-31 23:06:03.244450 7fc535bef700 2 Event(0x7fc547c40e80 nevent=5000 time_id=1).set_owner idx=0 owner=140484986992384 -26> 2017-08-31 23:06:03.244512 7fc53c812d00 1 Processor -- start -25> 2017-08-31 23:06:03.244568 7fc53c812d00 1 -- - start start -24> 2017-08-31 23:06:03.244573 7fc53c812d00 10 monclient: have 1 fsid cbc93c9d-f4ee-4039-b738-c09cb52bff9c -23> 2017-08-31 23:06:03.244701 7fc53c812d00 1 -- - shutdown_connections -22> 2017-08-31 23:06:03.244892 7fc53c812d00 1 -- - shutdown_connections -21> 2017-08-31 23:06:03.244920 7fc53c812d00 1 -- - wait complete. -20> 2017-08-31 23:06:03.244927 7fc53c812d00 1 -- - >> - conn(0x7fc547fa2000 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down -19> 2017-08-31 23:06:03.244940 7fc53c812d00 2 -- - >> - conn(0x7fc547fa2000 :-1 s=STATE_NONE pgs=0 cs=0 l=0)._stop -18> 2017-08-31 23:06:03.244989 7fc53c812d00 1 bluestore(/var/lib/ceph/tmp/mnt.3x9YTJ) mkfs path /var/lib/ceph/tmp/mnt.3x9YTJ -17> 2017-08-31 23:06:03.245053 7fc53c812d00 20 bluestore(/var/lib/ceph/tmp/mnt.3x9YTJ) _setup_block_symlink_or_file name block path size 10737418240 create=1 -16> 2017-08-31 23:06:03.245488 7fc53c812d00 20 bluestore(/var/lib/ceph/tmp/mnt.3x9YTJ) _setup_block_symlink_or_file name block.wal path size 100663296 create=0 -15> 2017-08-31 23:06:03.245505 7fc53c812d00 20 bluestore(/var/lib/ceph/tmp/mnt.3x9YTJ) _setup_block_symlink_or_file name block.db path size 0 create=0 -14> 2017-08-31 23:06:03.245540 7fc53c812d00 1 bdev create path /var/lib/ceph/tmp/mnt.3x9YTJ/block type kernel -13> 2017-08-31 23:06:03.245550 7fc53c812d00 1 bdev(0x7fc547c40800 /var/lib/ceph/tmp/mnt.3x9YTJ/block) open path /var/lib/ceph/tmp/mnt.3x9YTJ/block -12> 2017-08-31 23:06:03.246052 7fc53c812d00 1 bdev(0x7fc547c40800 /var/lib/ceph/tmp/mnt.3x9YTJ/block) open size 28291072 (0x1afb000, 27628 kB) block_size 4096 (4096 B) rotational -11> 2017-08-31 23:06:03.246073 7fc53c812d00 10 bluestore(/var/lib/ceph/tmp/mnt.3x9YTJ/block) _write_bdev_label path /var/lib/ceph/tmp/mnt.3x9YTJ/block label bdev(osd_uuid 55ffcfe9-cc63-49ef-9ef7-383999d8627b size 0x1afb000 btime 2017-08-31 23:06:03.246071 desc main) -10> 2017-08-31 23:06:03.246160 7fc53c812d00 1 bluestore(/var/lib/ceph/tmp/mnt.3x9YTJ) _set_cache_sizes max 0.5 < ratio 0.99 -9> 2017-08-31 23:06:03.246180 7fc53c812d00 1 bluestore(/var/lib/ceph/tmp/mnt.3x9YTJ) _set_cache_sizes cache_size 1073741824 meta 0.5 kv 0.5 data 0 -8> 2017-08-31 23:06:03.246188 7fc53c812d00 10 bluestore(/var/lib/ceph/tmp/mnt.3x9YTJ) _open_db kv_backend = rocksdb -7> 2017-08-31 23:06:03.246188 7fc53c812d00 10 bluestore(/var/lib/ceph/tmp/mnt.3x9YTJ) _open_db do_bluefs = 1 -6> 2017-08-31 23:06:03.246189 7fc53c812d00 10 bluestore(/var/lib/ceph/tmp/mnt.3x9YTJ) _open_db initializing bluefs -5> 2017-08-31 23:06:03.246208 7fc53c812d00 1 bdev create path /var/lib/ceph/tmp/mnt.3x9YTJ/block type kernel -4> 2017-08-31 23:06:03.246210 7fc53c812d00 1 bdev(0x7fc547ed1000 /var/lib/ceph/tmp/mnt.3x9YTJ/block) open path /var/lib/ceph/tmp/mnt.3x9YTJ/block -3> 2017-08-31 23:06:03.246309 7fc53c812d00 1 bdev(0x7fc547ed1000 /var/lib/ceph/tmp/mnt.3x9YTJ/block) open size 28291072 (0x1afb000, 27628 kB) block_size 4096 (4096 B) rotational -2> 2017-08-31 23:06:03.246314 7fc53c812d00 1 bluefs add_block_device bdev 1 path /var/lib/ceph/tmp/mnt.3x9YTJ/block size 27628 kB -1> 2017-08-31 23:06:03.246318 7fc53c812d00 1 bluefs add_block_extent bdev 1 0x7fffffffe0d00000~40000000 0> 2017-08-31 23:06:03.248558 7fc53c812d00 -1 /home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/12.2.0/rpm/el7/BUILD/ceph-12.2.0/src/os/bluestore/BlueFS.cc: In function 'void BlueFS::add_block_extent(unsigned int, uint64_t, uint64_t)' thread 7fc53c812d00 time 2017-08-31 23:06:03.246319 /home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/12.2.0/rpm/el7/BUILD/ceph-12.2.0/src/os/bluestore/BlueFS.cc: 172: FAILED assert(bdev[id]->get_size() >= offset + length) ceph version 12.2.0 (32ce2a3ae5239ee33d6150705cdb24d43bab910c) luminous (rc) 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x110) [0x7fc53d28f510] 2: (BlueFS::add_block_extent(unsigned int, unsigned long, unsigned long)+0x4d8) [0x7fc53d214f88] 3: (BlueStore::_open_db(bool)+0xc4f) [0x7fc53d13897f] 4: (BlueStore::mkfs()+0xd0d) [0x7fc53d14299d] 5: (OSD::mkfs(CephContext*, ObjectStore*, std::string const&, uuid_d, int)+0x29b) [0x7fc53ccf9f1b] 6: (main()+0xf42) [0x7fc53cc39972] 7: (__libc_start_main()+0xf5) [0x7fc538e72b35] 8: (()+0x4acb56) [0x7fc53ccd9b56] NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this. --- logging levels --- 0/ 5 none 0/ 1 lockdep 0/ 1 context 1/ 1 crush 1/ 5 mds 1/ 5 mds_balancer 1/ 5 mds_locker 1/ 5 mds_log 1/ 5 mds_log_expire 1/ 5 mds_migrator 0/ 1 buffer 0/ 1 timer 0/ 1 filer 0/ 1 striper 0/ 1 objecter 0/ 5 rados 0/ 5 rbd 0/ 5 rbd_mirror 0/ 5 rbd_replay 0/ 5 journaler 0/ 5 objectcacher 0/ 5 client 1/ 5 osd 0/ 5 optracker 0/ 5 objclass 1/ 3 filestore 1/ 3 journal 0/ 5 ms 1/ 5 mon 0/10 monc 1/ 5 paxos 0/ 5 tp 1/ 5 auth 1/ 5 crypto 1/ 1 finisher 1/ 5 heartbeatmap 1/ 5 perfcounter 1/ 5 rgw 1/10 civetweb 1/ 5 javaclient 1/ 5 asok 1/ 1 throttle 0/ 0 refs 1/ 5 xio 1/ 5 compressor 20/20 bluestore 1/ 5 bluefs 1/ 3 bdev 1/ 5 kstore 4/ 5 rocksdb 4/ 5 leveldb 4/ 5 memdb 1/ 5 kinetic 1/ 5 fuse 1/ 5 mgr 1/ 5 mgrc 1/ 5 dpdk 1/ 5 eventtrace -2/-2 (syslog threshold) -1/-1 (stderr threshold) max_recent 10000 max_new 1000 log_file /var/log/ceph/ceph-osd.0.log --- end dump of recent events --- 2017-08-31 23:06:03.250951 7fc53c812d00 -1 *** Caught signal (Aborted) ** in thread 7fc53c812d00 thread_name:ceph-osd ceph version 12.2.0 (32ce2a3ae5239ee33d6150705cdb24d43bab910c) luminous (rc) 1: (()+0xa23b21) [0x7fc53d250b21] 2: (()+0xf370) [0x7fc539e5c370] 3: (gsignal()+0x37) [0x7fc538e861d7] 4: (abort()+0x148) [0x7fc538e878c8] 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x284) [0x7fc53d28f684] 6: (BlueFS::add_block_extent(unsigned int, unsigned long, unsigned long)+0x4d8) [0x7fc53d214f88] 7: (BlueStore::_open_db(bool)+0xc4f) [0x7fc53d13897f] 8: (BlueStore::mkfs()+0xd0d) [0x7fc53d14299d] 9: (OSD::mkfs(CephContext*, ObjectStore*, std::string const&, uuid_d, int)+0x29b) [0x7fc53ccf9f1b] 10: (main()+0xf42) [0x7fc53cc39972] 11: (__libc_start_main()+0xf5) [0x7fc538e72b35] 12: (()+0x4acb56) [0x7fc53ccd9b56] NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this. --- begin dump of recent events --- 0> 2017-08-31 23:06:03.250951 7fc53c812d00 -1 *** Caught signal (Aborted) ** in thread 7fc53c812d00 thread_name:ceph-osd ceph version 12.2.0 (32ce2a3ae5239ee33d6150705cdb24d43bab910c) luminous (rc) 1: (()+0xa23b21) [0x7fc53d250b21] 2: (()+0xf370) [0x7fc539e5c370] 3: (gsignal()+0x37) [0x7fc538e861d7] 4: (abort()+0x148) [0x7fc538e878c8] 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x284) [0x7fc53d28f684] 6: (BlueFS::add_block_extent(unsigned int, unsigned long, unsigned long)+0x4d8) [0x7fc53d214f88] 7: (BlueStore::_open_db(bool)+0xc4f) [0x7fc53d13897f] 8: (BlueStore::mkfs()+0xd0d) [0x7fc53d14299d] 9: (OSD::mkfs(CephContext*, ObjectStore*, std::string const&, uuid_d, int)+0x29b) [0x7fc53ccf9f1b] 10: (main()+0xf42) [0x7fc53cc39972] 11: (__libc_start_main()+0xf5) [0x7fc538e72b35] 12: (()+0x4acb56) [0x7fc53ccd9b56] NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this. --- logging levels --- 0/ 5 none 0/ 1 lockdep 0/ 1 context 1/ 1 crush 1/ 5 mds 1/ 5 mds_balancer 1/ 5 mds_locker 1/ 5 mds_log 1/ 5 mds_log_expire 1/ 5 mds_migrator 0/ 1 buffer 0/ 1 timer 0/ 1 filer 0/ 1 striper 0/ 1 objecter 0/ 5 rados 0/ 5 rbd 0/ 5 rbd_mirror 0/ 5 rbd_replay 0/ 5 journaler 0/ 5 objectcacher 0/ 5 client 1/ 5 osd 0/ 5 optracker 0/ 5 objclass 1/ 3 filestore 1/ 3 journal 0/ 5 ms 1/ 5 mon 0/10 monc 1/ 5 paxos 0/ 5 tp 1/ 5 auth 1/ 5 crypto 1/ 1 finisher 1/ 5 heartbeatmap 1/ 5 perfcounter 1/ 5 rgw 1/10 civetweb 1/ 5 javaclient 1/ 5 asok 1/ 1 throttle 0/ 0 refs 1/ 5 xio 1/ 5 compressor 20/20 bluestore 1/ 5 bluefs 1/ 3 bdev 1/ 5 kstore 4/ 5 rocksdb 4/ 5 leveldb 4/ 5 memdb 1/ 5 kinetic 1/ 5 fuse 1/ 5 mgr 1/ 5 mgrc 1/ 5 dpdk 1/ 5 eventtrace -2/-2 (syslog threshold) -1/-1 (stderr threshold) max_recent 10000 max_new 1000 log_file /var/log/ceph/ceph-osd.0.log --- end dump of recent events ---
_______________________________________________ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com