Re: [one-users] One daemon crashing issue
Hi, It looks at first sight like a bug in the XMLRPC library. Could you please set ulimit -c unlimited and restart the ONE daemon? if it crashes again, please send the core dump file in $ONE_LOCATION/var. Regards, -Tino -- Constantino Vázquez Blanco, MSc OpenNebula Major Contributor www.OpenNebula.org | @tinova79 On Mon, May 9, 2011 at 7:29 AM, Prakhar Srivastava prakhar@gmail.com wrote: Hi, The opennebula frontend dumps the following error log on the screen sometimes and after that the connection is refused by one daemon. *** glibc detected *** /srv/cloud/one/bin/oned: double free or corruption (fasttop): 0x0a109ab0 *** === Backtrace: = /lib/libc.so.6(+0x6c501)[0xb702f501] /lib/libc.so.6(+0x6dd70)[0xb7030d70] /lib/libc.so.6(cfree+0x6d)[0xb7033e5d] /usr/lib/libxmlrpc.so.3(xmlrpc_DECREF+0x50)[0xb7276af0] /usr/lib/libxmlrpc.so.3(xmlrpc_array_get_item+0x5b)[0xb72786cb] /usr/lib/libxmlrpc.so.3(+0x495c)[0xb727795c] /usr/lib/libxmlrpc.so.3(xmlrpc_parse_value_va+0x32)[0xb7277c72] /usr/lib/libxmlrpc.so.3(xmlrpc_parse_value+0x32)[0xb7277cb2] /usr/lib/libxmlrpc_server.so.3(xmlrpc_dispatchCall+0x184)[0xb72ca284] /usr/lib/libxmlrpc_server.so.3(xmlrpc_registry_process_call+0xd5)[0xb72ca3b5] /usr/lib/libxmlrpc_server_abyss.so.3(+0x23f3)[0xb72d13f3] /usr/lib/libxmlrpc_abyss.so.3(+0x9dd9)[0xb72c1dd9] /usr/lib/libxmlrpc_abyss.so.3(+0x5830)[0xb72bd830] /usr/lib/libxmlrpc_abyss.so.3(+0xcd12)[0xb72c4d12] /lib/libpthread.so.0(+0x5cc9)[0xb7299cc9] /lib/libc.so.6(clone+0x5e)[0xb70936ae] === Memory map: 08048000-0811 r-xp 08:01 3280707 /srv/cloud/one/bin/oned 0811-08111000 r--p 000c7000 08:01 3280707 /srv/cloud/one/bin/oned 08111000-08112000 rw-p 000c8000 08:01 3280707 /srv/cloud/one/bin/oned 0a0df000-0a142000 rw-p 00:00 0 [heap] adafe000-adaff000 ---p 00:00 0 adaff000-ae2ff000 rw-p 00:00 0 ae2ff000-ae30 ---p 00:00 0 ae30-aeb0 rw-p 00:00 0 aeb0-aeb21000 rw-p 00:00 0 aeb21000-aec0 ---p 00:00 0 aec03000-aec04000 ---p 00:00 0 aec04000-af404000 rw-p 00:00 0 af404000-af405000 ---p 00:00 0 af405000-afc05000 rw-p 00:00 0 b0b0-b0b21000 rw-p 00:00 0 b0b21000-b0c0 ---p 00:00 0 b0c07000-b0c08000 ---p 00:00 0 b0c08000-b1408000 rw-p 00:00 0 b1408000-b1409000 ---p 00:00 0 b1409000-b1c09000 rw-p 00:00 0 b1c09000-b1c0a000 ---p 00:00 0 b1c0a000-b240a000 rw-p 00:00 0 b240a000-b240b000 ---p 00:00 0 b240b000-b2c0b000 rw-p 00:00 0 b2c0b000-b2c0c000 ---p 00:00 0 b2c0c000-b340c000 rw-p 00:00 0 b340c000-b340d000 ---p 00:00 0 b340d000-b3c0d000 rw-p 00:00 0 b3c0d000-b3c0e000 ---p 00:00 0 b3c0e000-b440e000 rw-p 00:00 0 b440e000-b440f000 ---p 00:00 0 b440f000-b4c0f000 rw-p 00:00 0 b4c0f000-b4c1 ---p 00:00 0 b4c1-b541 rw-p 00:00 0 b541-b5411000 ---p 00:00 0 b5411000-b5c11000 rw-p 00:00 0 b5c11000-b5c12000 ---p 00:00 0 b5c12000-b6412000 rw-p 00:00 0 b6412000-b6413000 ---p 00:00 0 b6413000-b6c13000 rw-p 00:00 0 b6c13000-b6c1d000 r-xp 08:01 2101708 /lib/libnss_files-2.12.1.so b6c1d000-b6c1e000 r--p 9000 08:01 2101708 /lib/libnss_files-2.12.1.so b6c1e000-b6c1f000 rw-p a000 08:01 2101708 /lib/libnss_files-2.12.1.so b6c1f000-b6c23000 rw-p 00:00 0 b6c23000-b6c26000 r-xp 08:01 2101383 /lib/libgpg-error.so.0.4.0 b6c26000-b6c27000 r--p 2000 08:01 2101383 /lib/libgpg-error.so.0.4.0 b6c27000-b6c28000 rw-p 3000 08:01 2101383 /lib/libgpg-error.so.0.4.0 b6c28000-b6c29000 rw-p 00:00 0 b6c29000-b6c9a000 r-xp 08:01 2101385 /lib/libgcrypt.so.11.5.3 b6c9a000-b6c9b000 r--p 0007 08:01 2101385 /lib/libgcrypt.so.11.5.3 b6c9b000-b6c9d000 rw-p 00071000 08:01 2101385 /lib/libgcrypt.so.11.5.3 b6c9d000-b6cac000 r-xp 08:01 1320837 /usr/lib/libtasn1.so.3.1.9 b6cac000-b6cad000 r--p e000 08:01 1320837 /usr/lib/libtasn1.so.3.1.9 b6cad000-b6cae000 rw-p f000 08:01 1320837 /usr/lib/libtasn1.so.3.1.9 b6cae000-b6cb r-xp 08:01 2101387 /lib/libkeyutils.so.1.3 b6cb-b6cb1000 r--p 1000 08:01 2101387 /lib/libkeyutils.so.1.3 b6cb1000-b6cb2000 rw-p 2000 08:01 2101387 /lib/libkeyutils.so.1.3 b6cb2000-b6cb8000 r-xp 08:01 1311681 /usr/lib/libkrb5support.so.0.1 b6cb8000-b6cb9000 r--p 5000 08:01 1311681 /usr/lib/libkrb5support.so.0.1 b6cb9000-b6cba000 rw-p 6000 08:01 1311681 /usr/lib/libkrb5support.so.0.1 b6cba000-b6cbc000 r-xp 08:01 2097163 /lib/libcom_err.so.2.1 b6cbc000-b6cbd000 r--p 1000 08:01 2097163 /lib/libcom_err.so.2.1 b6cbd000-b6cbe000 rw-p 2000 08:01 2097163
[one-users] One daemon crashing issue
Hi, The opennebula frontend dumps the following error log on the screen sometimes and after that the connection is refused by one daemon. *** glibc detected *** /srv/cloud/one/bin/oned: double free or corruption (fasttop): 0x0a109ab0 *** === Backtrace: = /lib/libc.so.6(+0x6c501)[0xb702f501] /lib/libc.so.6(+0x6dd70)[0xb7030d70] /lib/libc.so.6(cfree+0x6d)[0xb7033e5d] /usr/lib/libxmlrpc.so.3(xmlrpc_DECREF+0x50)[0xb7276af0] /usr/lib/libxmlrpc.so.3(xmlrpc_array_get_item+0x5b)[0xb72786cb] /usr/lib/libxmlrpc.so.3(+0x495c)[0xb727795c] /usr/lib/libxmlrpc.so.3(xmlrpc_parse_value_va+0x32)[0xb7277c72] /usr/lib/libxmlrpc.so.3(xmlrpc_parse_value+0x32)[0xb7277cb2] /usr/lib/libxmlrpc_server.so.3(xmlrpc_dispatchCall+0x184)[0xb72ca284] /usr/lib/libxmlrpc_server.so.3(xmlrpc_registry_process_call+0xd5)[0xb72ca3b5] /usr/lib/libxmlrpc_server_abyss.so.3(+0x23f3)[0xb72d13f3] /usr/lib/libxmlrpc_abyss.so.3(+0x9dd9)[0xb72c1dd9] /usr/lib/libxmlrpc_abyss.so.3(+0x5830)[0xb72bd830] /usr/lib/libxmlrpc_abyss.so.3(+0xcd12)[0xb72c4d12] /lib/libpthread.so.0(+0x5cc9)[0xb7299cc9] /lib/libc.so.6(clone+0x5e)[0xb70936ae] === Memory map: 08048000-0811 r-xp 08:01 3280707/srv/cloud/one/bin/oned 0811-08111000 r--p 000c7000 08:01 3280707/srv/cloud/one/bin/oned 08111000-08112000 rw-p 000c8000 08:01 3280707/srv/cloud/one/bin/oned 0a0df000-0a142000 rw-p 00:00 0 [heap] adafe000-adaff000 ---p 00:00 0 adaff000-ae2ff000 rw-p 00:00 0 ae2ff000-ae30 ---p 00:00 0 ae30-aeb0 rw-p 00:00 0 aeb0-aeb21000 rw-p 00:00 0 aeb21000-aec0 ---p 00:00 0 aec03000-aec04000 ---p 00:00 0 aec04000-af404000 rw-p 00:00 0 af404000-af405000 ---p 00:00 0 af405000-afc05000 rw-p 00:00 0 b0b0-b0b21000 rw-p 00:00 0 b0b21000-b0c0 ---p 00:00 0 b0c07000-b0c08000 ---p 00:00 0 b0c08000-b1408000 rw-p 00:00 0 b1408000-b1409000 ---p 00:00 0 b1409000-b1c09000 rw-p 00:00 0 b1c09000-b1c0a000 ---p 00:00 0 b1c0a000-b240a000 rw-p 00:00 0 b240a000-b240b000 ---p 00:00 0 b240b000-b2c0b000 rw-p 00:00 0 b2c0b000-b2c0c000 ---p 00:00 0 b2c0c000-b340c000 rw-p 00:00 0 b340c000-b340d000 ---p 00:00 0 b340d000-b3c0d000 rw-p 00:00 0 b3c0d000-b3c0e000 ---p 00:00 0 b3c0e000-b440e000 rw-p 00:00 0 b440e000-b440f000 ---p 00:00 0 b440f000-b4c0f000 rw-p 00:00 0 b4c0f000-b4c1 ---p 00:00 0 b4c1-b541 rw-p 00:00 0 b541-b5411000 ---p 00:00 0 b5411000-b5c11000 rw-p 00:00 0 b5c11000-b5c12000 ---p 00:00 0 b5c12000-b6412000 rw-p 00:00 0 b6412000-b6413000 ---p 00:00 0 b6413000-b6c13000 rw-p 00:00 0 b6c13000-b6c1d000 r-xp 08:01 2101708/lib/libnss_files-2.12.1.so b6c1d000-b6c1e000 r--p 9000 08:01 2101708/lib/libnss_files-2.12.1.so b6c1e000-b6c1f000 rw-p a000 08:01 2101708/lib/libnss_files-2.12.1.so b6c1f000-b6c23000 rw-p 00:00 0 b6c23000-b6c26000 r-xp 08:01 2101383/lib/libgpg-error.so.0.4.0 b6c26000-b6c27000 r--p 2000 08:01 2101383/lib/libgpg-error.so.0.4.0 b6c27000-b6c28000 rw-p 3000 08:01 2101383/lib/libgpg-error.so.0.4.0 b6c28000-b6c29000 rw-p 00:00 0 b6c29000-b6c9a000 r-xp 08:01 2101385/lib/libgcrypt.so.11.5.3 b6c9a000-b6c9b000 r--p 0007 08:01 2101385/lib/libgcrypt.so.11.5.3 b6c9b000-b6c9d000 rw-p 00071000 08:01 2101385/lib/libgcrypt.so.11.5.3 b6c9d000-b6cac000 r-xp 08:01 1320837/usr/lib/libtasn1.so.3.1.9 b6cac000-b6cad000 r--p e000 08:01 1320837/usr/lib/libtasn1.so.3.1.9 b6cad000-b6cae000 rw-p f000 08:01 1320837/usr/lib/libtasn1.so.3.1.9 b6cae000-b6cb r-xp 08:01 2101387/lib/libkeyutils.so.1.3 b6cb-b6cb1000 r--p 1000 08:01 2101387/lib/libkeyutils.so.1.3 b6cb1000-b6cb2000 rw-p 2000 08:01 2101387/lib/libkeyutils.so.1.3 b6cb2000-b6cb8000 r-xp 08:01 1311681 /usr/lib/libkrb5support.so.0.1 b6cb8000-b6cb9000 r--p 5000 08:01 1311681 /usr/lib/libkrb5support.so.0.1 b6cb9000-b6cba000 rw-p 6000 08:01 1311681 /usr/lib/libkrb5support.so.0.1 b6cba000-b6cbc000 r-xp 08:01 2097163/lib/libcom_err.so.2.1 b6cbc000-b6cbd000 r--p 1000 08:01 2097163/lib/libcom_err.so.2.1 b6cbd000-b6cbe000 rw-p 2000 08:01 2097163/lib/libcom_err.so.2.1 b6cbe000-b6cbf000 rw-p 00:00 0 b6cbf000-b6ce r-xp 08:01 1311672/usr/lib/libk5crypto.so.3.1 b6ce-b6ce1000 ---p 00021000 08:01 1311672/usr/lib/libk5crypto.so.3.1 b6ce1000-b6ce2000 r--p 00021000 08:01 1311672/usr/lib/libk5crypto.so.3.1 b6ce2000-b6ce3000 rw-p 00022000 08:01 1311672/usr/lib/libk5crypto.so.3.1 b6ce3000-b6d8b000 r-xp 08:01 1311678/usr/lib/libkrb5.so.3.3 b6d8b000-b6d9 r--p 000a8000 08:01 1311678
