Re: [OF-users] Problems with cluster

Igor Tue, 25 Mar 2008 00:30:51 -0700

I'm using X86-64:

Linux SAN-01.local 2.6.19.7-0.3.smp.gcc3.4.x86_64 #1 SMP Thu Apr 1201:51:26 EDT 2007 x86_64 x86_64 x86_64 GNU/Linux


Hereby the logs when starting drbd to death...

ï»¿Mar 25 05:04:46 SAN-01  -- root[3150]: ROOT LOGIN ON tty1â¨Mar 25 05:05:33 
SAN-01 kernel: drbd: initialised. Version: 8.0.2 (api:86/proto:86)â¨Mar 25 
05:05:33 SAN-01 kernel: drbd: SVN Revision: 2844 build by [EMAIL PROTECTED], 
2007-05-01 23:42:29â¨Mar 25 05:05:33 SAN-01 kernel: drbd: registered as block 
device major 147â¨Mar 25 05:05:33 SAN-01 kernel: drbd: minor_table @ 
0xffff81003cc4c380â¨Mar 25 05:05:33 SAN-01 kernel: drbd0: disk( Diskless -> 
Attaching ) â¨Mar 25 05:05:33 SAN-01 kernel: klogd 1.4.1, ---------- state 
change ---------- â¨Mar 25 05:05:33 SAN-01 kernel: drbd0: Found 6 transactions 
(42 active extents) in activity log.â¨Mar 25 05:05:33 SAN-01 kernel: drbd0: 
max_segment_size ( = BIO size ) = 32768â¨Mar 25 05:05:33 SAN-01 kernel: drbd0: 
drbd_bm_resize called with capacity == 594304â¨Mar 25 05:05:33 SAN-01 kernel: 
drbd0: resync bitmap: bits=74288 words=1161â¨Mar 25 05:05:33 SAN-01 kernel: 
drbd0: size = 290 MB (297152 KB)â¨Mar 25 05:05:33 SAN-01 kernel: drbd0: 
reading of bitmap took 1 jiffiesâ¨Mar 25 05:05:33 SAN-01 kernel: drbd0: 
recounting of set bits took additional 0 jiffiesâ¨Mar 25 05:05:33 SAN-01 
kernel: drbd0: 0 KB marked out-of-sync by on disk bit-map.â¨Mar 25 05:05:33 
SAN-01 kernel: drbd0: Marked additional 162 MB as out-of-sync based on 
AL.â¨Mar 25 05:05:33 SAN-01 kernel: drbd0: disk( Attaching -> UpToDate ) 
â¨Mar 25 05:05:33 SAN-01 kernel: drbd0: Writing meta data super block 
now.â¨Mar 25 05:05:33 SAN-01 kernel: drbd1: disk( Diskless -> Attaching ) 
â¨Mar 25 05:05:33 SAN-01 kernel: drbd1: Found 4 transactions (65 active 
extents) in activity log.â¨Mar 25 05:05:33 SAN-01 kernel: drbd1: 
max_segment_size ( = BIO size ) = 32768â¨Mar 25 05:05:33 SAN-01 kernel: drbd1: 
drbd_bm_resize called with capacity == 4294827920â¨Mar 25 05:05:33 SAN-01 
kernel: drbd1: resync bitmap: bits=536853490 words=8388336â¨Mar 25 05:05:33 
SAN-01 kernel: drbd1: size = 2047 GB (2147413960 KB)â¨Mar 25 05:05:33 SAN-01 
kernel: drbd1: reading of bitmap took 112 jiffiesâ¨Mar 25 05:05:33 SAN-01 
kernel: drbd1: recounting of set bits took additional 15 jiffiesâ¨Mar 25 
05:05:33 SAN-01 kernel: drbd1: 2038 GB marked out-of-sync by on disk 
bit-map.â¨Mar 25 05:05:33 SAN-01 kernel: drbd1: Marked additional 136 MB as 
out-of-sync based on AL.â¨Mar 25 05:05:34 SAN-01 kernel: drbd1: disk( 
Attaching -> UpToDate ) pdsk( DUnknown -> Outdated ) â¨Mar 25 05:05:34 SAN-01 
kernel: drbd1: Writing meta data super block now.â¨Mar 25 05:05:34 SAN-01 
kernel: drbd2: disk( Diskless -> Attaching ) â¨Mar 25 05:05:34 SAN-01 kernel: 
drbd2: No usable activity log found.â¨Mar 25 05:05:34 SAN-01 kernel: drbd2: 
max_segment_size ( = BIO size ) = 32768â¨Mar 25 05:05:34 SAN-01 kernel: drbd2: 
drbd_bm_resize called with capacity == 4294827920â¨Mar 25 05:05:34 SAN-01 
kernel: drbd2: resync bitmap: bits=536853490 words=8388336â¨Mar 25 05:05:34 
SAN-01 kernel: drbd2: size = 2047 GB (2147413960 KB)â¨Mar 25 05:05:34 SAN-01 
kernel: drbd2: reading of bitmap took 112 jiffiesâ¨Mar 25 05:05:34 SAN-01 
kernel: drbd2: recounting of set bits took additional 15 jiffiesâ¨Mar 25 
05:05:34 SAN-01 kernel: drbd2: 2036 GB marked out-of-sync by on disk 
bit-map.â¨Mar 25 05:05:34 SAN-01 kernel: drbd2: Marked additional 0 KB as 
out-of-sync based on AL.â¨Mar 25 05:05:34 SAN-01 kernel: drbd2: disk( 
Attaching -> UpToDate ) pdsk( DUnknown -> Outdated ) â¨Mar 25 05:05:34 SAN-01 
kernel: drbd2: Writing meta data super block now.â¨Mar 25 05:05:34 SAN-01 
kernel: drbd3: disk( Diskless -> Attaching ) â¨Mar 25 05:05:34 SAN-01 kernel: 
drbd3: No usable activity log found.â¨Mar 25 05:05:34 SAN-01 kernel: drbd3: 
max_segment_size ( = BIO size ) = 32768â¨Mar 25 05:05:34 SAN-01 kernel: drbd3: 
drbd_bm_resize called with capacity == 4294827920â¨Mar 25 05:05:34 SAN-01 
kernel: drbd3: resync bitmap: bits=536853490 words=8388336â¨Mar 25 05:05:34 
SAN-01 kernel: drbd3: size = 2047 GB (2147413960 KB)â¨Mar 25 05:05:35 SAN-01 
kernel: drbd3: reading of bitmap took 109 jiffiesâ¨Mar 25 05:05:35 SAN-01 
kernel: drbd3: recounting of set bits took additional 15 jiffiesâ¨Mar 25 
05:05:35 SAN-01 kernel: drbd3: 2036 GB marked out-of-sync by on disk 
bit-map.â¨Mar 25 05:05:35 SAN-01 kernel: drbd3: Marked additional 0 KB as 
out-of-sync based on AL.â¨Mar 25 05:05:35 SAN-01 kernel: drbd3: disk( 
Attaching -> UpToDate ) pdsk( DUnknown -> Outdated ) â¨Mar 25 05:05:35 SAN-01 
kernel: drbd3: Writing meta data super block now.â¨Mar 25 05:05:35 SAN-01 
kernel: drbd4: disk( Diskless -> Attaching ) â¨Mar 25 05:05:35 SAN-01 kernel: 
drbd4: No usable activity log found.â¨Mar 25 05:05:35 SAN-01 kernel: drbd4: 
max_segment_size ( = BIO size ) = 32768â¨Mar 25 05:05:35 SAN-01 kernel: drbd4: 
drbd_bm_resize called with capacity == 786788800â¨Mar 25 05:05:35 SAN-01 
kernel: drbd4: resync bitmap: bits=98348600 words=1536697â¨Mar 25 05:05:35 
SAN-01 kernel: drbd4: size = 375 GB (393394400 KB)â¨Mar 25 05:05:35 SAN-01 
kernel: drbd4: reading of bitmap took 21 jiffiesâ¨Mar 25 05:05:35 SAN-01 
kernel: drbd4: recounting of set bits took additional 3 jiffiesâ¨Mar 25 
05:05:35 SAN-01 kernel: drbd4: 362 GB marked out-of-sync by on disk 
bit-map.â¨Mar 25 05:05:35 SAN-01 kernel: drbd4: Marked additional 0 KB as 
out-of-sync based on AL.â¨Mar 25 05:05:35 SAN-01 kernel: drbd4: disk( 
Attaching -> UpToDate ) pdsk( DUnknown -> Outdated ) â¨Mar 25 05:05:35 SAN-01 
kernel: drbd4: Writing meta data super block now.â¨Mar 25 05:05:35 SAN-01 
kernel: drbd0: conn( StandAlone -> Unconnected ) â¨Mar 25 05:05:35 SAN-01 
kernel: drbd0: receiver (re)startedâ¨Mar 25 05:05:35 SAN-01 kernel: drbd0: 
conn( Unconnected -> WFConnection ) â¨Mar 25 05:05:35 SAN-01 kernel: drbd1: 
conn( StandAlone -> Unconnected ) â¨Mar 25 05:05:35 SAN-01 kernel: drbd1: 
receiver (re)startedâ¨Mar 25 05:05:35 SAN-01 kernel: drbd1: conn( Unconnected 
-> WFConnection ) â¨Mar 25 05:05:35 SAN-01 kernel: drbd2: conn( StandAlone -> 
Unconnected ) â¨Mar 25 05:05:35 SAN-01 kernel: drbd2: receiver 
(re)startedâ¨Mar 25 05:05:35 SAN-01 kernel: drbd2: conn( Unconnected -> 
WFConnection ) â¨Mar 25 05:05:35 SAN-01 kernel: drbd3: conn( StandAlone -> 
Unconnected ) â¨Mar 25 05:05:35 SAN-01 kernel: drbd3: receiver 
(re)startedâ¨Mar 25 05:05:35 SAN-01 kernel: drbd3: conn( Unconnected -> 
WFConnection ) â¨Mar 25 05:05:35 SAN-01 kernel: drbd0: conn( WFConnection -> 
WFReportParams ) â¨Mar 25 05:05:35 SAN-01 kernel: drbd0: Handshake successful: 
DRBD Network Protocol version 86â¨Mar 25 05:05:35 SAN-01 kernel: drbd1: conn( 
WFConnection -> WFReportParams ) â¨Mar 25 05:05:35 SAN-01 kernel: drbd1: 
Handshake successful: DRBD Network Protocol version 86â¨Mar 25 05:05:35 SAN-01 
kernel: drbd0: peer( Unknown -> Secondary ) conn( WFReportParams -> WFBitMapS ) 
pdsk( DUnknown -> UpToDate ) â¨Mar 25 05:05:35 SAN-01 kernel: drbd0: Writing 
meta data super block now.â¨Mar 25 05:05:35 SAN-01 kernel: drbd0: conn( 
WFBitMapS -> SyncSource ) pdsk( UpToDate -> Inconsistent ) â¨Mar 25 05:05:35 
SAN-01 kernel: drbd0: Began resync as SyncSource (will sync 166080 KB [41520 
bits set]).â¨Mar 25 05:05:35 SAN-01 kernel: drbd0: Writing meta data super 
block now.â¨Mar 25 05:05:35 SAN-01 kernel: drbd4: conn( StandAlone -> 
Unconnected ) â¨Mar 25 05:05:35 SAN-01 kernel: drbd4: receiver 
(re)startedâ¨Mar 25 05:05:35 SAN-01 kernel: drbd4: conn( Unconnected -> 
WFConnection ) â¨Mar 25 05:05:35 SAN-01 kernel: drbd2: conn( WFConnection -> 
WFReportParams ) â¨Mar 25 05:05:35 SAN-01 kernel: drbd2: Handshake successful: 
DRBD Network Protocol version 86â¨Mar 25 05:05:35 SAN-01 kernel: drbd4: conn( 
WFConnection -> WFReportParams ) â¨Mar 25 05:05:35 SAN-01 kernel: drbd4: 
Handshake successful: DRBD Network Protocol version 86â¨Mar 25 05:05:35 SAN-01 
kernel: drbd1: Becoming sync source due to disk states.â¨Mar 25 05:05:35 
SAN-01 kernel: drbd1: peer( Unknown -> Secondary ) conn( WFReportParams -> 
WFBitMapS ) pdsk( Outdated -> Inconsistent ) â¨Mar 25 05:05:35 SAN-01 kernel: 
drbd3: conn( WFConnection -> WFReportParams ) â¨Mar 25 05:05:36 SAN-01 kernel: 
drbd3: Handshake successful: DRBD Network Protocol version 86â¨Mar 25 05:05:37 
SAN-01 kernel: drbd2: Becoming sync source due to disk states.â¨Mar 25 
05:05:39 SAN-01 kernel: drbd2: peer( Unknown -> Secondary ) conn( 
WFReportParams -> WFBitMapS ) pdsk( Outdated -> Inconsistent ) â¨Mar 25 
05:05:39 SAN-01 kernel: drbd4: Becoming sync source due to disk states.â¨Mar 
25 05:05:40 SAN-01 kernel: drbd4: peer( Unknown -> Secondary ) conn( 
WFReportParams -> WFBitMapS ) pdsk( Outdated -> Inconsistent ) â¨Mar 25 
05:05:40 SAN-01 kernel: drbd3: Becoming sync source due to disk states.â¨Mar 
25 05:05:40 SAN-01 kernel: drbd3: peer( Unknown -> Secondary ) conn( 
WFReportParams -> WFBitMapS ) pdsk( Outdated -> Inconsistent ) â¨Mar 25 
05:05:43 SAN-01 kernel: drbd4: Writing meta data super block now.â¨Mar 25 
05:05:43 SAN-01 kernel: drbd4: BUG! md_sync_timer expired! Worker calls 
drbd_md_sync().â¨Mar 25 05:05:50 SAN-01 kernel: drbd4: conn( WFBitMapS -> 
SyncSource ) â¨Mar 25 05:05:50 SAN-01 kernel: drbd4: Began resync as 
SyncSource (will sync 380336352 KB [95084088 bits set]).â¨Mar 25 05:05:50 
SAN-01 kernel: drbd4: Writing meta data super block now.â¨Mar 25 05:06:08 
SAN-01 kernel: drbd0: role( Secondary -> Primary ) â¨Mar 25 05:06:25 SAN-01 
kernel: drbd3: Writing meta data super block now.â¨Mar 25 05:06:25 SAN-01 
kernel: drbd3: BUG! md_sync_timer expired! Worker calls drbd_md_sync().â¨Mar 
25 05:06:27 SAN-01 kernel: drbd1: Writing meta data super block now.â¨Mar 25 
05:06:27 SAN-01 kernel: drbd1: BUG! md_sync_timer expired! Worker calls 
drbd_md_sync().â¨Mar 25 05:06:33 SAN-01 kernel: drbd2: Writing meta data super 
block now.â¨Mar 25 05:06:33 SAN-01 kernel: drbd2: BUG! md_sync_timer expired! 
Worker calls drbd_md_sync().â¨Mar 25 05:06:45 SAN-01 kernel: kjournald 
starting.  Commit interval 5 secondsâ¨Mar 25 05:06:50 SAN-01 kernel: EXT3 FS 
on drbd0, internal journalâ¨Mar 25 05:06:50 SAN-01 kernel: EXT3-fs: recovery 
complete.â¨Mar 25 05:06:56 SAN-01 kernel: EXT3-fs: mounted filesystem with 
ordered data mode.â¨Mar 25 05:07:14 SAN-01 kernel: drbd3: conn( WFBitMapS -> 
SyncSource ) â¨Mar 25 05:07:14 SAN-01 kernel: drbd3: Began resync as 
SyncSource (will sync 2135814088 KB [533953522 bits set]).â¨Mar 25 05:07:14 
SAN-01 kernel: drbd3: Writing meta data super block now.â¨Mar 25 05:07:16 
SAN-01 kernel: drbd1: conn( WFBitMapS -> SyncSource ) â¨Mar 25 05:07:16 SAN-01 
kernel: drbd1: Began resync as SyncSource (will sync 2137345992 KB [534336498 
bits set]).â¨Mar 25 05:07:16 SAN-01 kernel: drbd1: Writing meta data super 
block now.â¨Mar 25 05:07:21 SAN-01 kernel: drbd2: conn( WFBitMapS -> 
SyncSource ) â¨Mar 25 05:07:21 SAN-01 kernel: drbd2: Began resync as 
SyncSource (will sync 2135814088 KB [533953522 bits set]).â¨Mar 25 05:07:21 
SAN-01 kernel: drbd2: Writing meta data super block now.â¨Mar 25 05:07:51 
SAN-01 kernel: drbd0: Resync done (total 136 sec; paused 0 sec; 1220 
K/sec)â¨Mar 25 05:07:51 SAN-01 kernel: drbd0: conn( SyncSource -> Connected ) 
pdsk( Inconsistent -> UpToDate ) â¨Mar 25 05:07:51 SAN-01 kernel: drbd0: 
Writing meta data super block now.â¨Mar 25 05:10:01 SAN-01 
crond(pam_unix)[3653]: session opened for user root by (uid=0)â¨Mar 25 
05:10:01 SAN-01 crond(pam_unix)[3653]: session closed for user rootâ¨Mar 25 
05:13:09 SAN-01 ntpd[3033]: synchronized to 78.47.136.228, stratum=2â¨Mar 25 
05:13:10 SAN-01 ntpd[3033]: time reset +1.314162 sâ¨Mar 25 05:13:10 SAN-01 
ntpd[3033]: kernel time sync disabled 0041â¨Mar 25 05:17:29 SAN-01 ntpd[3033]: 
synchronized to 217.79.182.184, stratum=2â¨Mar 25 05:19:36 SAN-01 
login(pam_unix)[3150]: session closed for user rootâ¨Mar 25 05:19:44 SAN-01 
login(pam_unix)[3659]: session opened for user root by (uid=0)â¨Mar 25 
05:19:44 SAN-01  -- root[3659]: ROOT LOGIN ON tty1â¨Mar 25 05:20:01 SAN-01 
crond(pam_unix)[3727]: session opened for user root by (uid=0)â¨Mar 25 
05:20:02 SAN-01 crond(pam_unix)[3727]: session closed for user rootâ¨Mar 25 
05:20:31 SAN-01 kernel: drbd1: role( Secondary -> Primary ) â¨Mar 25 05:21:45 
SAN-01 ntpd[3033]: kernel time sync enabled 0001â¨Mar 25 05:28:24 SAN-01 
kernel: sendmail invoked oom-killer: gfp_mask=0x201d2, order=0, 
oomkilladj=0â¨Mar 25 05:28:24 SAN-01 kernel: â¨Mar 25 05:28:24 SAN-01 kernel: 
Call Trace:â¨Mar 25 05:28:24 SAN-01 kernel:  [<ffffffff802b39bd>] 
out_of_memory+0x79/0x27fâ¨Mar 25 05:28:24 SAN-01 kernel:  [<ffffffff8020e889>] 
__alloc_pages+0x22a/0x2a7â¨Mar 25 05:28:24 SAN-01 kernel:  
[<ffffffff802b2a3d>] __page_cache_alloc+0x66/0x68â¨Mar 25 05:28:24 SAN-01 
kernel:  [<ffffffff80211a54>] __do_page_cache_readahead+0xb1/0x21eâ¨Mar 25 
05:28:24 SAN-01 kernel:  [<ffffffff80227256>] sync_page+0x0/0x3fâ¨Mar 25 
05:28:24 SAN-01 kernel:  [<ffffffff80262349>] io_schedule+0x26/0x32â¨Mar 25 
05:28:24 SAN-01 kernel:  [<ffffffff8026252e>] 
__wait_on_bit_lock+0x5f/0x6eâ¨Mar 25 05:28:24 SAN-01 kernel:  
[<ffffffff80212346>] filemap_nopage+0x150/0x33bâ¨Mar 25 05:28:24 SAN-01 
kernel:  [<ffffffff80208805>] __handle_mm_fault+0x22c/0xa16â¨Mar 25 05:28:24 
SAN-01 kernel:  [<ffffffff8026571f>] do_page_fault+0x413/0x784â¨Mar 25 
05:28:24 SAN-01 kernel:  [<ffffffff80253c3d>] proc_delete_inode+0x0/0x6câ¨Mar 
25 05:28:24 SAN-01 kernel:  [<ffffffff80263bbd>] error_exit+0x0/0x84â¨Mar 25 
05:28:24 SAN-01 kernel: â¨Mar 25 05:28:24 SAN-01 kernel: Mem-info:â¨Mar 25 
05:28:24 SAN-01 kernel: Node 0 DMA per-cpu:â¨Mar 25 05:28:24 SAN-01 kernel: 
CPU    0: Hot: hi:    0, btch:   1 usd:   0   Cold: hi:    0, btch:   1 usd:   
0â¨Mar 25 05:28:24 SAN-01 kernel: Node 0 DMA32 per-cpu:â¨Mar 25 05:28:24 
SAN-01 kernel: CPU    0: Hot: hi:  186, btch:  31 usd:   0   Cold: hi:   62, 
btch:  15 usd:  46â¨Mar 25 05:28:24 SAN-01 kernel: Active:932 inactive:1008 
dirty:0 writeback:0 unstable:0 free:2004 slab:4891 mapped:758 
pagetables:184â¨Mar 25 05:28:24 SAN-01 kernel: Node 0 DMA free:4012kB min:44kB 
low:52kB high:64kB active:0kB inactive:0kB present:11472kB pages_scanned:0 
all_unreclaimable? yesâ¨Mar 25 05:28:24 SAN-01 kernel: lowmem_reserve[]: 0 992 
992â¨Mar 25 05:28:24 SAN-01 kernel: Node 0 DMA32 free:4004kB min:4004kB 
low:5004kB high:6004kB active:3728kB inactive:4032kB present:1016504kB 
pages_scanned:11802 all_unreclaimable? yesâ¨Mar 25 05:28:24 SAN-01 kernel: 
lowmem_reserve[]: 0 0 0â¨Mar 25 05:28:24 SAN-01 kernel: Node 0 DMA: 1*4kB 
1*8kB 0*16kB 1*32kB 0*64kB 1*128kB 1*256kB 1*512kB 1*1024kB 1*2048kB 0*4096kB = 
4012kBâ¨Mar 25 05:28:24 SAN-01 kernel: Node 0 DMA32: 15*4kB 13*8kB 4*16kB 
2*32kB 0*64kB 1*128kB 0*256kB 1*512kB 1*1024kB 1*2048kB 0*4096kB = 4004kBâ¨Mar 
25 05:28:24 SAN-01 kernel: Swap cache: add 2330, delete 1829, find 2/4, race 
0+0â¨Mar 25 05:28:24 SAN-01 kernel: Free swap  = 994796kBâ¨Mar 25 05:28:24 
SAN-01 kernel: Total swap = 1004052kBâ¨Mar 25 05:28:24 SAN-01 kernel: Free 
swap:       994796kBâ¨Mar 25 05:28:24 SAN-01 kernel: 261744 pages of RAMâ¨Mar 
25 05:28:24 SAN-01 kernel: 5097 reserved pagesâ¨Mar 25 05:28:24 SAN-01 kernel: 
2752 pages sharedâ¨Mar 25 05:28:24 SAN-01 kernel: 501 pages swap cachedâ¨Mar 
25 05:28:24 SAN-01 kernel: Out of Memory: Kill process 3091 (sendmail) score 
7286 and children.â¨Mar 25 05:28:24 SAN-01 kernel: Out of memory: Killed 
process 3091 (sendmail).â¨Mar 25 05:28:24 SAN-01 kernel: klogd invoked 
oom-killer: gfp_mask=0x200d2, order=0, oomkilladj=0â¨Mar 25 05:28:24 SAN-01 
kernel: â¨Mar 25 05:28:24 SAN-01 kernel: Call Trace:â¨Mar 25 05:28:24 SAN-01 
kernel:  [<ffffffff802b39bd>] out_of_memory+0x79/0x27fâ¨Mar 25 05:28:24 SAN-01 
kernel:  [<ffffffff8020e889>] __alloc_pages+0x22a/0x2a7â¨Mar 25 05:28:24 
SAN-01 kernel:  [<ffffffff8022fe20>] read_swap_cache_async+0x47/0xf2â¨Mar 25 
05:28:24 SAN-01 kernel:  [<ffffffff802b8dd1>] swapin_readahead+0x61/0xd4â¨Mar 
25 05:28:24 SAN-01 kernel:  [<ffffffff80208d01>] 
__handle_mm_fault+0x728/0xa16â¨Mar 25 05:28:24 SAN-01 kernel:  
[<ffffffff802858bb>] __wake_up_common+0x42/0x61â¨Mar 25 05:28:24 SAN-01 
kernel:  [<ffffffff8022c182>] __wake_up+0x35/0x4bâ¨Mar 25 05:28:24 SAN-01 
kernel:  [<ffffffff8026571f>] do_page_fault+0x413/0x784â¨Mar 25 05:28:24 
SAN-01 kernel:  [<ffffffff80244fe7>] sock_aio_write+0x113/0x12bâ¨Mar 25 
05:28:24 SAN-01 kernel:  [<ffffffff80263bbd>] error_exit+0x0/0x84â¨Mar 25 
05:28:24 SAN-01 kernel:  [<ffffffff80346a4b>] vgacon_cursor+0x0/0x1a7â¨Mar 25 
05:28:24 SAN-01 kernel:  [<ffffffff80346a4b>] vgacon_cursor+0x0/0x1a7â¨Mar 25 
05:28:24 SAN-01 kernel:  [<ffffffff80289afb>] do_syslog+0x18c/0x3abâ¨Mar 25 
05:28:24 SAN-01 kernel:  [<ffffffff80289ac4>] do_syslog+0x155/0x3abâ¨Mar 25 
05:28:24 SAN-01 kernel:  [<ffffffff80298878>] 
autoremove_wake_function+0x0/0x2eâ¨Mar 25 05:28:24 SAN-01 kernel:  
[<ffffffff80298878>] autoremove_wake_function+0x0/0x2eâ¨Mar 25 05:28:24 SAN-01 
kernel:  [<ffffffff802ee019>] kmsg_read+0x38/0x42â¨Mar 25 05:28:24 SAN-01 
kernel:  [<ffffffff8020ac14>] vfs_read+0xd1/0x172â¨Mar 25 05:28:24 SAN-01 
kernel:  [<ffffffff80210824>] sys_read+0x45/0x6eâ¨Mar 25 05:28:24 SAN-01 
kernel:  [<ffffffff8025d11e>] system_call+0x7e/0x83â¨Mar 25 05:28:24 SAN-01 
kernel: â¨Mar 25 05:28:24 SAN-01 kernel: Mem-info:â¨Mar 25 05:28:24 SAN-01 
kernel: Node 0 DMA per-cpu:â¨Mar 25 05:28:24 SAN-01 kernel: CPU    0: Hot: hi: 
   0, btch:   1 usd:   0   Cold: hi:    0, btch:   1 usd:   0â¨Mar 25 05:28:24 
SAN-01 kernel: Node 0 DMA32 per-cpu:â¨Mar 25 05:28:24 SAN-01 kernel: CPU    0: 
Hot: hi:  186, btch:  31 usd:  30   Cold: hi:   62, btch:  15 usd:  46â¨Mar 25 
05:28:24 SAN-01 kernel: Active:932 inactive:1008 dirty:0 writeback:0 unstable:0 
free:1973 slab:4891 mapped:758 pagetables:184â¨Mar 25 05:28:24 SAN-01 kernel: 
Node 0 DMA free:4012kB min:44kB low:52kB high:64kB active:0kB inactive:0kB 
present:11472kB pages_scanned:0 all_unreclaimable? yesâ¨Mar 25 05:28:24 SAN-01 
kernel: lowmem_reserve[]: 0 992 992â¨Mar 25 05:28:24 SAN-01 kernel: Node 0 
DMA32 free:3880kB min:4004kB low:5004kB high:6004kB active:3728kB 
inactive:4032kB present:1016504kB pages_scanned:11802 all_unreclaimable? 
yesâ¨Mar 25 05:28:24 SAN-01 kernel: lowmem_reserve[]: 0 0 0â¨Mar 25 05:28:24 
SAN-01 kernel: Node 0 DMA: 1*4kB 1*8kB 0*16kB 1*32kB 0*64kB 1*128kB 1*256kB 
1*512kB 1*1024kB 1*2048kB 0*4096kB = 4012kBâ¨Mar 25 05:28:24 SAN-01 kernel: 
Node 0 DMA32: 0*4kB 5*8kB 4*16kB 2*32kB 0*64kB 1*128kB 0*256kB 1*512kB 1*1024kB 
1*2048kB 0*4096kB = 3880kBâ¨Mar 25 05:28:24 SAN-01 kernel: Swap cache: add 
2330, delete 1829, find 2/5, race 0+0â¨Mar 25 05:28:24 SAN-01 kernel: Free 
swap  = 994796kBâ¨Mar 25 05:28:24 SAN-01 kernel: Total swap = 1004052kBâ¨Mar 
25 05:28:24 SAN-01 kernel: Free swap:       994796kBâ¨Mar 25 05:28:24 SAN-01 
kernel: 261744 pages of RAMâ¨Mar 25 05:28:24 SAN-01 kernel: 5097 reserved 
pagesâ¨Mar 25 05:28:24 SAN-01 kernel: 2691 pages sharedâ¨Mar 25 05:28:29 
SAN-01 kernel: 501 pages swap cachedâ¨Mar 25 05:28:29 SAN-01 kernel: sendmail 
invoked oom-killer: gfp_mask=0x201d2, order=0, oomkilladj=0â¨



So it looks like there is a bug:

Mar 25 05:05:43 SAN-01 kernel: drbd4: BUG! md_sync_timer expired!Worker calls drbd_md_sync()



igor ([EMAIL PROTECTED])
--------------------------------


Am 24.03.2008 um 17:07 schrieb Rafiu Fakunle:

Igor wrote:
I managed  to get my cluster up and running.
So disks are syncing from primary to secondary, but after a whilethe primary host begins to kill all processes and panics with outof mem.
I resolved that the logging-daemon for drbd is filling up memorywithout freeing it any more.
Second thing is that I can't create any directory on the"metadata"-device. creating files is no problem, only creatingdirectories is not possible.
I only get Input/output errors.

Anyone with an idea?
i386 or x86-64 openfiler?
igor ([EMAIL PROTECTED])
--------------------------------

_______________________________________________
Openfiler-users mailing list
[email protected]
https://lists.openfiler.com/mailman/listinfo/openfiler-users

_______________________________________________
Openfiler-users mailing list
[email protected]
https://lists.openfiler.com/mailman/listinfo/openfiler-users

Re: [OF-users] Problems with cluster

Reply via email to