Am 30.11.2011 12:22, schrieb Vladislav Bogdanov:
30.11.2011 14:08, Vadim Bulst wrote:
Hello,

first of all I'd like to ask you a general question:

Does somebody successfully set up a clvm cluster with pacemaker and run
it in productive mode?
I will say yes after I finally resolve remaining dlm&fencing issues.

Now back to the concrete problem:

  I configured two interfaces for corosync:

root@bbzclnode04:~# corosync-cfgtool -s
Printing ring status.
Local node ID 897624256
RING ID 0
     id    = 192.168.128.53
     status    = ring 0 active with no faults
RING ID 1
     id    = 192.168.129.23
     status    = ring 1 active with no faults

RRD set to passive

I also made some changes to my cib:

node bbzclnode04
node bbzclnode06
node bbzclnode07
primitive clvm ocf:lvm2:clvmd \
     params daemon_timeout="30" \
     meta target-role="Started"
Please instruct clvmd to use corosync stack instead of openais (-I
corosync): otherwise it uses LCK service which is not mature and I
observed major problems with it.

primitive dlm ocf:pacemaker:controld \
     meta target-role="Started"
group dlm-clvm dlm clvm
clone dlm-clvm-clone dlm-clvm \
     meta interleave="true" ordered="true"
property $id="cib-bootstrap-options" \
     dc-version="1.1.5-01e86afaaa6d4a8c4836f68df80ababd6ca3902f" \
     cluster-infrastructure="openais" \
     expected-quorum-votes="3" \
     no-quorum-policy="ignore" \
     stonith-enabled="false" \
     last-lrm-refresh="1322643084"

I cleaned and restarted the resources - nothing! :

crm(live)resource# cleanup dlm-clvm-clone
Cleaning up dlm:0 on bbzclnode04
Cleaning up dlm:0 on bbzclnode06
Cleaning up dlm:0 on bbzclnode07
Cleaning up clvm:0 on bbzclnode04
Cleaning up clvm:0 on bbzclnode06
Cleaning up clvm:0 on bbzclnode07
Cleaning up dlm:1 on bbzclnode04
Cleaning up dlm:1 on bbzclnode06
Cleaning up dlm:1 on bbzclnode07
Cleaning up clvm:1 on bbzclnode04
Cleaning up clvm:1 on bbzclnode06
Cleaning up clvm:1 on bbzclnode07
Cleaning up dlm:2 on bbzclnode04
Cleaning up dlm:2 on bbzclnode06
Cleaning up dlm:2 on bbzclnode07
Cleaning up clvm:2 on bbzclnode04
Cleaning up clvm:2 on bbzclnode06
Cleaning up clvm:2 on bbzclnode07
Waiting for 19 replies from the CRMd................... OK

crm_mon:

============
Last updated: Wed Nov 30 10:15:09 2011
Stack: openais
Current DC: bbzclnode04 - partition with quorum
Version: 1.1.5-01e86afaaa6d4a8c4836f68df80ababd6ca3902f
3 Nodes configured, 3 expected votes
1 Resources configured.
============

Online: [ bbzclnode04 bbzclnode06 bbzclnode07 ]


Failed actions:
     clvm:1_start_0 (node=bbzclnode06, call=11, rc=1, status=complete):
unknown error
     clvm:0_start_0 (node=bbzclnode04, call=11, rc=1, status=complete):
unknown error
     clvm:2_start_0 (node=bbzclnode07, call=11, rc=1, status=complete):
unknown error


When I look in the log - there is a message which tells me that may be
another clvm process is already running - but it isn't so.

"clvmd could not create local socket Another clvmd is probably already
running"

Or is it a permission problem - writing to the filesystem? Is there a
way to get rid of it?
You can try to run it manually under strace. It will show you what happens.


Here we go:

root@bbzclnode07:~# strace clvmd -d  -I cororsync
execve("/usr/sbin/clvmd", ["clvmd", "-d", "-I", "cororsync"], [/* 18 vars */]) 
= 0
brk(0)                                  = 0x12f7000
access("/etc/ld.so.nohwcap", F_OK)      = -1 ENOENT (No such file or directory)
mmap(NULL, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 
0x7f9f09dad000
access("/etc/ld.so.preload", R_OK)      = -1 ENOENT (No such file or directory)
open("/etc/ld.so.cache", O_RDONLY)      = 3
fstat(3, {st_mode=S_IFREG|0644, st_size=25864, ...}) = 0
mmap(NULL, 25864, PROT_READ, MAP_PRIVATE, 3, 0) = 0x7f9f09da6000
close(3)                                = 0
access("/etc/ld.so.nohwcap", F_OK)      = -1 ENOENT (No such file or directory)
open("/lib/x86_64-linux-gnu/libdl.so.2", O_RDONLY) = 3
read(3, "\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0\340\r\0\0\0\0\0\0"..., 
832) = 832
fstat(3, {st_mode=S_IFREG|0644, st_size=14768, ...}) = 0
mmap(NULL, 2109704, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 
0x7f9f0998b000
mprotect(0x7f9f0998d000, 2097152, PROT_NONE) = 0
mmap(0x7f9f09b8d000, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x2000) = 0x7f9f09b8d000
close(3)                                = 0
access("/etc/ld.so.nohwcap", F_OK)      = -1 ENOENT (No such file or directory)
open("/lib/libdevmapper-event.so.1.02.1", O_RDONLY) = 3
read(3, "\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0 \24\0\0\0\0\0\0"..., 
832) = 832
fstat(3, {st_mode=S_IFREG|0644, st_size=18704, ...}) = 0
mmap(NULL, 2113872, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 
0x7f9f09786000
mprotect(0x7f9f0978a000, 2093056, PROT_NONE) = 0
mmap(0x7f9f09989000, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x3000) = 0x7f9f09989000
close(3)                                = 0
access("/etc/ld.so.nohwcap", F_OK)      = -1 ENOENT (No such file or directory)
open("/lib/libdevmapper.so.1.02.1", O_RDONLY) = 3
read(3, "\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0`L\0\0\0\0\0\0"..., 832) 
= 832
fstat(3, {st_mode=S_IFREG|0644, st_size=143296, ...}) = 0
mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 
0x7f9f09da5000
mmap(NULL, 2238488, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 
0x7f9f09563000
mprotect(0x7f9f09583000, 2097152, PROT_NONE) = 0
mmap(0x7f9f09783000, 12288, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x20000) = 0x7f9f09783000
close(3)                                = 0
access("/etc/ld.so.nohwcap", F_OK)      = -1 ENOENT (No such file or directory)
open("/usr/lib/libcman.so.3", O_RDONLY) = 3
read(3, "\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0 \23\0\0\0\0\0\0"..., 
832) = 832
fstat(3, {st_mode=S_IFREG|0644, st_size=22544, ...}) = 0
mmap(NULL, 2117800, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 
0x7f9f0935d000
mprotect(0x7f9f09361000, 2097152, PROT_NONE) = 0
mmap(0x7f9f09561000, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x4000) = 0x7f9f09561000
close(3)                                = 0
access("/etc/ld.so.nohwcap", F_OK)      = -1 ENOENT (No such file or directory)
open("/usr/lib/libconfdb.so.4", O_RDONLY) = 3
read(3, "\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0P\35\0\0\0\0\0\0"..., 
832) = 832
fstat(3, {st_mode=S_IFREG|0644, st_size=51680, ...}) = 0
mmap(NULL, 2148992, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 
0x7f9f09150000
mprotect(0x7f9f0915b000, 2097152, PROT_NONE) = 0
mmap(0x7f9f0935b000, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0xb000) = 0x7f9f0935b000
close(3)                                = 0
access("/etc/ld.so.nohwcap", F_OK)      = -1 ENOENT (No such file or directory)
open("/usr/lib/libdlm.so.3", O_RDONLY)  = 3
read(3, "\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0\260\25\0\0\0\0\0\0"..., 
832) = 832
fstat(3, {st_mode=S_IFREG|0644, st_size=18624, ...}) = 0
mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 
0x7f9f09da4000
mmap(NULL, 2113912, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 
0x7f9f08f4b000
mprotect(0x7f9f08f4f000, 2093056, PROT_NONE) = 0
mmap(0x7f9f0914e000, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x3000) = 0x7f9f0914e000
close(3)                                = 0
access("/etc/ld.so.nohwcap", F_OK)      = -1 ENOENT (No such file or directory)
open("/lib/x86_64-linux-gnu/libpthread.so.0", O_RDONLY) = 3
read(3, "\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0Pl\0\0\0\0\0\0"..., 832) 
= 832
fstat(3, {st_mode=S_IFREG|0755, st_size=135500, ...}) = 0
mmap(NULL, 2212920, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 
0x7f9f08d2e000
mprotect(0x7f9f08d46000, 2093056, PROT_NONE) = 0
mmap(0x7f9f08f45000, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x17000) = 0x7f9f08f45000 mmap(0x7f9f08f47000, 13368, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_ANONYMOUS, -1, 0) = 0x7f9f08f47000
close(3)                                = 0
access("/etc/ld.so.nohwcap", F_OK)      = -1 ENOENT (No such file or directory)
open("/usr/lib/libcpg.so.4", O_RDONLY)  = 3
read(3, "\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0`\21\0\0\0\0\0\0"..., 
832) = 832
fstat(3, {st_mode=S_IFREG|0644, st_size=26928, ...}) = 0
mmap(NULL, 2122104, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 
0x7f9f08b27000
mprotect(0x7f9f08b2d000, 2093056, PROT_NONE) = 0
mmap(0x7f9f08d2c000, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x5000) = 0x7f9f08d2c000
close(3)                                = 0
access("/etc/ld.so.nohwcap", F_OK)      = -1 ENOENT (No such file or directory)
open("/usr/lib/libSaLck.so.3", O_RDONLY) = 3
read(3, "\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0p\16\0\0\0\0\0\0"..., 
832) = 832
fstat(3, {st_mode=S_IFREG|0644, st_size=26952, ...}) = 0
mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 
0x7f9f09da3000
mmap(NULL, 2122128, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 
0x7f9f08920000
mprotect(0x7f9f08926000, 2093056, PROT_NONE) = 0
mmap(0x7f9f08b25000, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x5000) = 0x7f9f08b25000
close(3)                                = 0
access("/etc/ld.so.nohwcap", F_OK)      = -1 ENOENT (No such file or directory)
open("/usr/lib/libquorum.so.4", O_RDONLY) = 3
read(3, "\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0\360\v\0\0\0\0\0\0"..., 
832) = 832
fstat(3, {st_mode=S_IFREG|0644, st_size=14480, ...}) = 0
mmap(NULL, 2109656, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 
0x7f9f0871c000
mprotect(0x7f9f0871f000, 2093056, PROT_NONE) = 0
mmap(0x7f9f0891e000, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x2000) = 0x7f9f0891e000
close(3)                                = 0
access("/etc/ld.so.nohwcap", F_OK)      = -1 ENOENT (No such file or directory)
open("/lib/x86_64-linux-gnu/libc.so.6", O_RDONLY) = 3
read(3, "\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0 \24\2\0\0\0\0\0"..., 
832) = 832
fstat(3, {st_mode=S_IFREG|0755, st_size=1677624, ...}) = 0
mmap(NULL, 3793768, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 
0x7f9f0837d000
mprotect(0x7f9f08512000, 2093056, PROT_NONE) = 0
mmap(0x7f9f08711000, 20480, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x194000) = 0x7f9f08711000 mmap(0x7f9f08716000, 21352, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_ANONYMOUS, -1, 0) = 0x7f9f08716000
close(3)                                = 0
access("/etc/ld.so.nohwcap", F_OK)      = -1 ENOENT (No such file or directory)
open("/lib/x86_64-linux-gnu/libselinux.so.1", O_RDONLY) = 3
read(3, "\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0`Q\0\0\0\0\0\0"..., 832) 
= 832
fstat(3, {st_mode=S_IFREG|0644, st_size=117720, ...}) = 0
mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 
0x7f9f09da2000
mmap(NULL, 2217512, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 
0x7f9f0815f000
mprotect(0x7f9f0817b000, 2093056, PROT_NONE) = 0
mmap(0x7f9f0837a000, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x1b000) = 0x7f9f0837a000 mmap(0x7f9f0837c000, 1576, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_ANONYMOUS, -1, 0) = 0x7f9f0837c000
close(3)                                = 0
access("/etc/ld.so.nohwcap", F_OK)      = -1 ENOENT (No such file or directory)
open("/lib/x86_64-linux-gnu/libudev.so.0", O_RDONLY) = 3
read(3, "\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0\2401\0\0\0\0\0\0"..., 
832) = 832
fstat(3, {st_mode=S_IFREG|0644, st_size=55176, ...}) = 0
mmap(NULL, 2150448, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 
0x7f9f07f51000
mprotect(0x7f9f07f5e000, 2093056, PROT_NONE) = 0
mmap(0x7f9f0815d000, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0xc000) = 0x7f9f0815d000
close(3)                                = 0
access("/etc/ld.so.nohwcap", F_OK)      = -1 ENOENT (No such file or directory)
open("/usr/lib/libcoroipcc.so.4", O_RDONLY) = 3
read(3, "\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0\240\23\0\0\0\0\0\0"..., 
832) = 832
fstat(3, {st_mode=S_IFREG|0644, st_size=22872, ...}) = 0
mmap(NULL, 2118040, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 
0x7f9f07d4b000
mprotect(0x7f9f07d50000, 2093056, PROT_NONE) = 0
mmap(0x7f9f07f4f000, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x4000) = 0x7f9f07f4f000
close(3)                                = 0
mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 
0x7f9f09da1000
access("/etc/ld.so.nohwcap", F_OK)      = -1 ENOENT (No such file or directory)
open("/lib/x86_64-linux-gnu/librt.so.1", O_RDONLY) = 3
read(3, "\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0\200!\0\0\0\0\0\0"..., 
832) = 832
fstat(3, {st_mode=S_IFREG|0644, st_size=31752, ...}) = 0
mmap(NULL, 2129016, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 
0x7f9f07b43000
mprotect(0x7f9f07b4a000, 2093056, PROT_NONE) = 0
mmap(0x7f9f07d49000, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x6000) = 0x7f9f07d49000
close(3)                                = 0
mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 
0x7f9f09da0000
mmap(NULL, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 
0x7f9f09d9e000
arch_prctl(ARCH_SET_FS, 0x7f9f09d9e7c0) = 0
mprotect(0x7f9f07d49000, 4096, PROT_READ) = 0
mprotect(0x7f9f07f4f000, 4096, PROT_READ) = 0
mprotect(0x7f9f0815d000, 4096, PROT_READ) = 0
mprotect(0x7f9f0837a000, 4096, PROT_READ) = 0
mprotect(0x7f9f08711000, 16384, PROT_READ) = 0
mprotect(0x7f9f0891e000, 4096, PROT_READ) = 0
mprotect(0x7f9f08b25000, 4096, PROT_READ) = 0
mprotect(0x7f9f08d2c000, 4096, PROT_READ) = 0
mprotect(0x7f9f08f45000, 4096, PROT_READ) = 0
mprotect(0x7f9f0914e000, 4096, PROT_READ) = 0
mprotect(0x7f9f0935b000, 4096, PROT_READ) = 0
mprotect(0x7f9f09561000, 4096, PROT_READ) = 0
mprotect(0x7f9f09783000, 4096, PROT_READ) = 0
mprotect(0x7f9f09989000, 4096, PROT_READ) = 0
mprotect(0x7f9f09b8d000, 4096, PROT_READ) = 0
mprotect(0x67f000, 4096, PROT_READ)     = 0
mprotect(0x7f9f09daf000, 4096, PROT_READ) = 0
munmap(0x7f9f09da6000, 25864)           = 0
set_tid_address(0x7f9f09d9ea90)         = 2847
set_robust_list(0x7f9f09d9eaa0, 0x18)   = 0
futex(0x7ffff6d7cb7c, FUTEX_WAKE_PRIVATE, 1) = 0
futex(0x7ffff6d7cb7c, FUTEX_WAIT_BITSET_PRIVATE|FUTEX_CLOCK_REALTIME, 1, NULL, 7f9f09d9e7c0) = -1 EAGAIN (Resource temporarily unavailable)
rt_sigaction(SIGRTMIN, {0x7f9f08d346c0, [], SA_RESTORER|SA_SIGINFO, 
0x7f9f08d3e060}, NULL, 8) = 0
rt_sigaction(SIGRT_1, {0x7f9f08d34750, [], SA_RESTORER|SA_RESTART|SA_SIGINFO, 0x7f9f08d3e060}, NULL, 8) = 0
rt_sigprocmask(SIG_UNBLOCK, [RTMIN RT_1], NULL, 8) = 0
getrlimit(RLIMIT_STACK, {rlim_cur=8192*1024, rlim_max=RLIM_INFINITY}) = 0
statfs("/selinux", {f_type="EXT2_SUPER_MAGIC", f_bsize=4096, f_blocks=8285134, f_bfree=7803671, f_bavail=7382807, f_files=2105344, f_ffree=2016160, f_fsid={-1739579276, -1310995585}, f_namelen=255, f_frsize=4096}) = 0
brk(0)                                  = 0x12f7000
brk(0x1318000)                          = 0x1318000
open("/proc/filesystems", O_RDONLY)     = 3
fstat(3, {st_mode=S_IFREG|0444, st_size=0, ...}) = 0
mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 
0x7f9f09dac000
read(3, "nodev\tsysfs\nnodev\trootfs\nnodev\tb"..., 1024) = 325
read(3, "", 1024)                       = 0
close(3)                                = 0
munmap(0x7f9f09dac000, 4096)            = 0
getuid()                                = 0
geteuid()                               = 0
socket(PF_FILE, SOCK_STREAM, 0)         = 3
connect(3, {sa_family=AF_FILE, path="/var/run/lvm/clvmd.sock"}, 110) = -1 ENOENT (No such file or directory)
close(3)                                = 0
open("/etc/localtime", O_RDONLY)        = 3
fstat(3, {st_mode=S_IFREG|0644, st_size=2309, ...}) = 0
fstat(3, {st_mode=S_IFREG|0644, st_size=2309, ...}) = 0
mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 
0x7f9f09dac000
read(3, "TZif2\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\10\0\0\0\10\0\0\0\0"..., 
4096) = 2309
lseek(3, -1467, SEEK_CUR)               = 842
read(3, "TZif2\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\t\0\0\0\t\0\0\0\0"..., 4096) 
= 1467
close(3)                                = 0
munmap(0x7f9f09dac000, 4096)            = 0
write(2, "CLVMD[9d9e7c0]: Nov 30 12:51:22 ", 32CLVMD[9d9e7c0]: Nov 30 12:51:22 
) = 32
write(2, "CLVMD started\n", 14CLVMD started
)         = 14
unlink("/var/run/lvm/clvmd.sock")       = -1 ENOENT (No such file or directory)
umask(077)                              = 022
socket(PF_FILE, SOCK_STREAM, 0)         = 3
fcntl(3, F_SETFD, FD_CLOEXEC)           = 0
fcntl(3, F_GETFL)                       = 0x2 (flags O_RDWR)
fcntl(3, F_SETFL, O_RDWR|O_NONBLOCK)    = 0
bind(3, {sa_family=AF_FILE, path="/var/run/lvm/clvmd.sock"}, 110) = -1 ENOENT (No such file or directory)
write(2, "  ", 2  )                       = 2
write(2, "can't bind local socket: No such"..., 50can't bind local socket: No such file or directory) = 50
write(2, "\n", 1
)                       = 1
close(3)                                = 0
unlink("/var/run/lvm/clvmd.sock")       = -1 ENOENT (No such file or directory)
umask(022)                              = 077
exit_group(2)                           = ?



I created now the directory "/var/run/lvm" . It wasn't there - work for the 
package maintainer.

IT WORKS NOW - thanks for Your help Vladislav :-))


Shell I use a different distro - our install from source?


Am 24.11.2011 22:59, schrieb Andreas Kurz:
Hello,

On 11/24/2011 10:12 PM, Vadim Bulst wrote:
Hi Andreas,

I changed my cib:

node bbzclnode04
node bbzclnode06
node bbzclnode07
primitive clvm ocf:lvm2:clvmd \
         params daemon_timeout="30"
primitive dlm ocf:pacemaker:controld
group g_lock dlm clvm
clone g_lock-clone g_lock \
         meta interleave="true"
property $id="cib-bootstrap-options" \
         dc-version="1.1.5-01e86afaaa6d4a8c4836f68df80ababd6ca3902f" \
         cluster-infrastructure="openais" \
         expected-quorum-votes="3" \
         no-quorum-policy="ignore" \
         stonith-enabled="false" \
         last-lrm-refresh="1322049979

but no luck at all.
I assume you did at least a cleanup on clvm and it still does not work
... next step would be to grep for ERROR in your cluster log and look
for other suspicious messages to find out why clvm is not that motivated
to start.

"And use Corosync 1.4.x with redundant rings and automatic ring recovery
feature enabled."

I got two interfaces per server - there are bonded together and bridged
for virtualization.  Only one untagged vlan. I tried to give a tagged
Vlan Bridge a Address but didn't worked. My network conf looks like that:
One ore two extra nics are quite affordable today to build e.g. a direct
connection between the nodes (if possible)

Regards,
Andreas



_______________________________________________
Pacemaker mailing list: Pacemaker@oss.clusterlabs.org
http://oss.clusterlabs.org/mailman/listinfo/pacemaker

Project Home: http://www.clusterlabs.org
Getting started: http://www.clusterlabs.org/doc/Cluster_from_Scratch.pdf
Bugs: http://bugs.clusterlabs.org

--
Mit freundlichen Grüßen

Vadim Bulst
Systemadministrator BBZ

Biotechnologisch-Biomedizinisches Zentrum
Universität Leipzig
Deutscher Platz 5, 04103 Leipzig
Tel.: 0341 97 - 31 307
Fax : 0341 97 - 31 309



_______________________________________________
Pacemaker mailing list: Pacemaker@oss.clusterlabs.org
http://oss.clusterlabs.org/mailman/listinfo/pacemaker

Project Home: http://www.clusterlabs.org
Getting started: http://www.clusterlabs.org/doc/Cluster_from_Scratch.pdf
Bugs: http://bugs.clusterlabs.org

_______________________________________________
Pacemaker mailing list: Pacemaker@oss.clusterlabs.org
http://oss.clusterlabs.org/mailman/listinfo/pacemaker

Project Home: http://www.clusterlabs.org
Getting started: http://www.clusterlabs.org/doc/Cluster_from_Scratch.pdf
Bugs: http://bugs.clusterlabs.org



--
Mit freundlichen Grüßen

Vadim Bulst
Systemadministrator BBZ

Biotechnologisch-Biomedizinisches Zentrum
Universität Leipzig
Deutscher Platz 5, 04103 Leipzig
Tel.: 0341 97 - 31 307
Fax : 0341 97 - 31 309


_______________________________________________
Pacemaker mailing list: Pacemaker@oss.clusterlabs.org
http://oss.clusterlabs.org/mailman/listinfo/pacemaker

Project Home: http://www.clusterlabs.org
Getting started: http://www.clusterlabs.org/doc/Cluster_from_Scratch.pdf
Bugs: http://bugs.clusterlabs.org

Reply via email to