I have Solaris 10 U2 with all the latest patches that started to crash recently
on regular basis... so I started to dig and see what is causing it and here is
what I found out:
panic[cpu1]/thread=2a1009a7cc0: really out of space
02a1009a6d70 zfs:zio_write_allocate_gang_members+33c (60017964140, 400, 200,
3, 7b62f380, 7b64d400)
%l0-3: 060017964158 0003
%l4-7: 03000ff13200 03000ff13000 0001
02a1009a6e70 zfs:zio_write_allocate_gang_members+2dc (600179643c0, 800, 200,
400, 7b62f380, 7b64d400)
%l0-3: 0600179643d8 0003 0400
%l4-7: 03000ff13000 03001666d500 0001
02a1009a6f70 zfs:zio_write_allocate_gang_members+2dc (600167e1740, 800, 400,
800, 7b62f380, 7b64d400)
%l0-3: 0600167e1758 0001 1a00
%l4-7: 03001666d500 03001674b800 0001
02a1009a7070 zfs:zio_write_allocate_gang_members+2dc (600167e19c0, 4e00,
1400, 1a00, 7b62f380, 7b64d400)
%l0-3: 0600167e19d8 0003 1a00
%l4-7: 03001674b800 03001557db00 0001
02a1009a7170 zfs:zio_write_allocate_gang_members+2dc (6000b690d80, 4e00,
3c00, 4e00, 7b62f380, 7b64d400)
%l0-3: 06000b690d98 0001 ee00
%l4-7: 03001557db00 030023477000 0001
02a1009a7270 zfs:zio_write_compress+1ec (6000b690d80, 23e20b, 23e000,
ff00ff, 3, 30023477000)
%l0-3: 0076 0077 ee00
%l4-7: 00ff fc00 00ff
02a1009a7340 zfs:arc_write+e4 (6000b690d80, 6ebee00, 6, 3, 1, d02188b)
%l0-3: 7b605eec 03002702a328 030020863c08
%l4-7: 02a1009a7548 0004 0004 030006b703a0
02a1009a7450 zfs:zfsctl_ops_root+b223eac (3002702a328, 600085451c0, 12f956,
3, 6, d02188b)
%l0-3: 060001dccb00 06000b514658 03002702a448
%l4-7: 030023477000 0013 0d60
02a1009a7570 zfs:dnode_sync+35c (0, 0, 600085451c0, 600162ed7d8, 0, 3)
%l0-3: 03002702a328 06000b5146b0 06000b514770 06000b514710
%l4-7: 0060 06000b5146b3 000c 03002703d7a0
02a1009a7630 zfs:dmu_objset_sync_dnodes+6c (60001dccb00, 60001dccc40,
600162ed7d8, 6000b514658, 0, 0)
%l0-3: 703e0438 703e 703e 0001
%l4-7: 703dc000 0600085451c0
02a1009a76e0 zfs:dmu_objset_sync+54 (60001dccb00, 600162ed7d8, 3, 3,
3002331e8f8, d02188b)
%l0-3: 00bb 000f 00410d60
%l4-7: 060001dccc40 0060 060001dccbe0 060001dccc60
02a1009a77f0 zfs:dsl_dataset_sync+c (60008aefa40, 600162ed7d8, 60008aefad0,
30ad278, 30ad278, 60008aefa40)
%l0-3: 0001 0007 030ad2f8 0003
%l4-7: 060008aefac8
02a1009a78a0 zfs:dsl_pool_sync+104 (30ad1c0, d02188b, 60008aefa40,
30005fc8148, 60001dcc880, 60001dcc8a8)
%l0-3: 06ebf1b8 0006 0600162ed7d8
%l4-7: 030ad328 030ad2f8 030ad268
02a1009a7950 zfs:spa_sync+e4 (6ebee00, d02188b, 60001dcc8a8,
600162ed7d8, 6ebef78, 2a1009a7cbc)
%l0-3: 0d021889 06ebef40 06ebef08
%l4-7: 06e4a080 030ad1c0 01e0
02a1009a7a00 zfs:txg_sync_thread+134 (30ad1c0, d02188b, 0, 2a1009a7ab0,
30ad2d0, 30ad2d2)
%l0-3: 030ad2e0 030ad290 030ad298
%l4-7: 030ad2d6 030ad2d4 030ad288 0d021848
syncing file systems... 970 913 893 893 893 893 893 893 893 893 893 893 893 893
893
SC Alert: Failed to send email alert for recent event.
893 893 893 893 893 893 893 893 done (not all i/o completed)
dumping to /dev/dsk/c1t0d0s1, offset 3436969984, content: kernel
59% done
SC Alert: SC Request to XIR Host due to Watchdog
ERROR: Externally Initiated Reset has occurred.
panic[cpu1]/thread=2a1009a7cc0: sync initiated
dump aborted: please record the above information!
rebooting...
SC Alert: Host System has Reset
XIR/Watchdog Reset
Executing Power On Self Test
0
Any help? I do zfs file system snaps and I am pretty low on disk space at this
moment but I still have like 2 gig free
mypool/d 182163718 180277654 1886065 99% /d/d2
Thanks for help.
Chris
___
zfs-discuss mailing list
zfs-discuss@opensolaris.org
