iozone test crashed on ceph

2012-05-31 Thread udit agarwal
Hi, I have set up ceph system with a client, mon and mds on one system which is connected to 2 osds. I ran iozone test with a 10G file and it ran fine. But when I ran iozone test with a 5G file, the process got killed and our ceph system hanged. Can anyone please help me with this. Thanks in adv

Re: iozone test crashed on ceph

2012-05-31 Thread Sam Just
Hi, Thanks for letting us know. What version are you running? Can you post your ceph.conf to give us an idea of how your cluster is configured? Also, did any of the daemons crash? If it's reproducible, it would help to turn up osd and mds debugging to 20 and post the logs. Thanks -Sam On Thu

Re: iozone test crashed on ceph

2012-05-31 Thread udit agarwal
Hi, thanks for your reply. The output of 'modinfo ceph' is as follows: filename: /lib/modules/3.1.10-1.9-desktop/kernel/fs/ceph/ceph.ko license:GPL description:Ceph filesystem for Linux author: Patience Warnick author: Yehuda Sadeh author: Sage Weil s

Re: iozone test crashed on ceph

2012-06-01 Thread Greg Farnum
On Thursday, May 31, 2012 at 5:58 PM, udit agarwal wrote: > Hi, > I have set up ceph system with a client, mon and mds on one system which is > connected to 2 osds. I ran iozone test with a 10G file and it ran fine. But > when > I ran iozone test with a 5G file, the process got killed and our ceph

Re: iozone test crashed on ceph

2012-06-04 Thread udit agarwal
I ran the 5g iozone test on my ceph system and I got the following output on the terminal: hp1:/media/ceph # /opt/iozone/bin/iozone -Rab 20120519_1641_results_5g.xls -R -i 0 -i 2 -f /media/ceph/iozone.file -s 5g Iozone: Performance Test of File I/O Version $Revision: 3.408

Re: iozone test crashed on ceph

2012-06-04 Thread Tommi Virtanen
On Mon, Jun 4, 2012 at 2:52 PM, udit agarwal wrote: > I ran the 5g iozone test on my ceph system and I got the following output on > the > terminal: ... > Message from syslogd@hp1 at Jun  4 22:19:03 ... >  kernel:[ 7627.132065] Oops: [#1] PREEMPT SMP > Message from syslogd@hp1 at Jun  4 22:1

Re: iozone test crashed on ceph

2012-06-04 Thread udit agarwal
Hi, Thanks for your reply. Please follow this link "https://docs.google.com/document";. "d/1mYVyI75FGMYqPes5T5fkI0aUX8h2q6TFeWdoV9uJdQI/edit?pli=1" to find the whole message. (plz concatenate both strings for the link as I wasn't able to post it in whole i.e. link is https://?pli=1 .

Re: iozone test crashed on ceph

2012-06-04 Thread udit agarwal
Sorry ,the link is: https://docs.google.com/document/d/ 1mYVyI75FGMYqPes5T5fkI0aUX8h2q6TFeWdoV9uJdQI/edit?pli=1 hope you can help me in this matter. --Udit Agarwal -- To unsubscribe from this list: send the line "unsubscribe ceph-devel" in the body of a message to majord...@vger.kernel.org Mo

Re: iozone test crashed on ceph

2012-06-05 Thread Tommi Virtanen
On Mon, Jun 4, 2012 at 4:43 PM, udit agarwal wrote: > Sorry ,the link is: [...] If you run iozone again, does the bug happen again? Comparing your iozone run with our test suite, we don't currently do -i 2 (random read/write), and we only run a few specific record sizes to save time (-r 16K,1M);

Re: iozone test crashed on ceph

2012-06-05 Thread udit agarwal
Hi, Thanks for your reply. After you hinted that this problem may have caused due to using record size of length 4k. Then, I ran iozone test on a 5m file with record length 4k and to my surprise, the ceph system again hanged up. Then, I tried same with record lengths from 8k to 1m and everything

Re: iozone test crashed on ceph

2012-06-05 Thread udit agarwal
Hi, Thank you all for your support in resolving the issue. As I mentioned in my previous post that I ran my iozone test again on a 5G file excluding the 4k record size. And now, I have successfully completed this test with record sizes of 8k and 16k and hopefully all others will also work fine. Bu

Re: iozone test crashed on ceph

2012-06-06 Thread Tommi Virtanen
On Tue, Jun 5, 2012 at 9:15 PM, udit agarwal wrote: > Hi, >  Thank you all for your support in resolving the issue. As I mentioned in my > previous post that I ran my iozone test again on a 5G file excluding the 4k > record size. And now, I have successfully completed this test with record > size