Thanks, Mike
On 5/31/13 12:05 PM, Becky Ligon wrote:
Mike:
There is something going on with your system, as I am able to touch 500
files in 12.5 seconds and delete them in 8.8 seconds on our cluster.
Did you remove all of ATTR entries from your conf file and restart the
servers?
If not, please do so and then capture the output from the following and
send it to me:
for i in `seq 1 500`; do time touch myfile${i}; done
and then
for i in myfile*; do time rm -f ${i}; done.
Thanks,
Becky
On Fri, May 31, 2013 at 12:02 PM, Michael Robbert <[email protected]
<mailto:[email protected]>> wrote:
top - 09:54:53 up 6 days, 19:11, 1 user, load average: 0.00, 0.00,
0.00
Tasks: 156 total, 1 running, 155 sleeping, 0 stopped, 0 zombie
Cpu(s): 0.1%us, 0.2%sy, 0.0%ni, 99.8%id, 0.0%wa, 0.0%hi,
0.0%si, 0.0%st
Mem: 12289220k total, 1322196k used, 10967024k free, 85820k buffers
Swap: 2104432k total, 232k used, 2104200k free, 965636k cached
They all look very similar to this. 232k swap used on all of them
throughout a touch/rm of 100 files. Ganglia doesn't show any change
over time with cache on or off.
Mike
On 5/31/13 9:30 AM, Becky Ligon wrote:
Michael:
Can you send me a screen shot of "top" from your servers when the
metadata is running on the local disk? I'd like to see how much
memory
is available. I'm wondering if 1GB for your DB cache is too high,
possibly causing excessive swapping.
Becky
On Fri, May 24, 2013 at 6:06 PM, Michael Robbert
<[email protected] <mailto:[email protected]>
<mailto:[email protected] <mailto:[email protected]>>> wrote:
We recently noticed a performance problem with our OrangeFS
server.
Here are the server stats:
3 servers, built identically with identical hardware
[root@orangefs02 ~]# /usr/sbin/pvfs2-server --version
2.8.7-orangefs (mode: aio-threaded)
[root@orangefs02 ~]# uname -r
2.6.18-308.16.1.el5.584g0000
4 core E5603 1.60GHz
12GB of RAM
OrangeFS is being served to clients using bmi_tcp over DDR
Infiniband.
Backend storage is PanFS with 2x10Gig connections on the
servers.
Performance to the backend looks fine using bonnie++.
>100MB/sec
write and ~250MB/s read to each stack. ~300 creates/sec.
On the OrangeFS clients are running kernel version
2.6.18-238.19.1.el5.
The biggest problem I have right now is that delete are
taking a
long time. Almost 1 sec per file.
[root@fatcompute-11-32
L_10_V0.2_eta0.3_wRes_____truncerr1e-11]# find
N2/|wc -l
137
[root@fatcompute-11-32
L_10_V0.2_eta0.3_wRes_____truncerr1e-11]# time
rm -rf N2
real 1m31.096s
user 0m0.000s
sys 0m0.015s
Similar results for file creates:
[root@fatcompute-11-32 ]# date;for i in `seq 1 50`;do touch
file${i};done;date
Fri May 24 16:04:17 MDT 2013
Fri May 24 16:05:05 MDT 2013
What else do you need to know? Which debug flags? What
should we be
looking at?
I don't see any load on the servers and I've restarted
server and
rebooted server nodes.
Thanks for any pointers,
Mike Robbert
Colorado School of Mines
_________________________________________________
Pvfs2-users mailing list
Pvfs2-users@beowulf-__underground.org
<mailto:[email protected]>
<mailto:Pvfs2-users@beowulf-__underground.org
<mailto:[email protected]>>
http://www.beowulf-__underground.org/mailman/__listinfo/pvfs2-users
<http://www.beowulf-underground.org/mailman/listinfo/pvfs2-users>
--
Becky Ligon
OrangeFS Support and Development
Omnibond Systems
Anderson, South Carolina
--
Becky Ligon
OrangeFS Support and Development
Omnibond Systems
Anderson, South Carolina
[root@fatcompute-11-32 orangefs]# for i in `seq 1 500`; do time touch
myfile${i}; done
...
real 0m0.630s
user 0m0.000s
sys 0m0.000s
real 0m0.736s
user 0m0.000s
sys 0m0.002s
real 0m0.615s
user 0m0.000s
sys 0m0.000s
real 0m0.015s
user 0m0.000s
sys 0m0.001s
real 0m0.316s
user 0m0.000s
sys 0m0.001s
real 0m0.347s
user 0m0.000s
sys 0m0.001s
real 0m0.345s
user 0m0.000s
sys 0m0.000s
real 0m0.666s
user 0m0.000s
sys 0m0.001s
real 0m0.017s
user 0m0.000s
sys 0m0.000s
real 0m0.766s
user 0m0.001s
sys 0m0.001s
real 0m0.278s
user 0m0.000s
sys 0m0.001s
real 0m0.675s
user 0m0.001s
sys 0m0.001s
real 0m0.530s
user 0m0.000s
sys 0m0.001s
real 0m0.407s
user 0m0.000s
sys 0m0.002s
real 0m0.700s
user 0m0.000s
sys 0m0.001s
real 0m0.380s
user 0m0.000s
sys 0m0.001s
real 0m0.338s
user 0m0.000s
sys 0m0.000s
real 0m0.750s
user 0m0.001s
sys 0m0.001s
real 0m0.280s
user 0m0.000s
sys 0m0.000s
real 0m0.709s
user 0m0.000s
sys 0m0.001s
real 0m0.705s
user 0m0.000s
sys 0m0.001s
real 0m0.671s
user 0m0.000s
sys 0m0.001s
real 0m0.613s
user 0m0.000s
sys 0m0.002s
real 0m0.598s
user 0m0.000s
sys 0m0.002s
real 0m0.270s
user 0m0.000s
sys 0m0.000s
real 0m0.708s
user 0m0.000s
sys 0m0.002s
real 0m0.735s
user 0m0.000s
sys 0m0.001s
real 0m0.330s
user 0m0.000s
sys 0m0.001s
real 0m0.614s
user 0m0.000s
sys 0m0.001s
real 0m0.609s
user 0m0.000s
sys 0m0.003s
real 0m0.592s
user 0m0.000s
sys 0m0.001s
real 0m0.304s
user 0m0.001s
sys 0m0.001s
real 0m0.595s
user 0m0.001s
sys 0m0.000s
real 0m0.387s
user 0m0.000s
sys 0m0.001s
real 0m0.541s
user 0m0.000s
sys 0m0.001s
real 0m0.655s
user 0m0.000s
sys 0m0.002s
real 0m0.543s
user 0m0.000s
sys 0m0.002s
real 0m0.643s
user 0m0.000s
sys 0m0.001s
real 0m0.634s
user 0m0.000s
sys 0m0.002s
real 0m0.348s
user 0m0.000s
sys 0m0.002s
real 0m0.631s
user 0m0.000s
sys 0m0.001s
real 0m0.686s
user 0m0.000s
sys 0m0.002s
real 0m0.607s
user 0m0.000s
sys 0m0.001s
real 0m0.693s
user 0m0.000s
sys 0m0.002s
real 0m0.605s
user 0m0.000s
sys 0m0.000s
real 0m0.645s
user 0m0.000s
sys 0m0.002s
real 0m0.273s
user 0m0.000s
sys 0m0.001s
real 0m0.274s
user 0m0.000s
sys 0m0.001s
real 0m0.632s
user 0m0.001s
sys 0m0.000s
real 0m0.704s
user 0m0.000s
sys 0m0.001s
real 0m0.605s
user 0m0.000s
sys 0m0.001s
real 0m0.375s
user 0m0.000s
sys 0m0.001s
real 0m0.659s
user 0m0.000s
sys 0m0.001s
real 0m0.667s
user 0m0.000s
sys 0m0.000s
real 0m0.567s
user 0m0.001s
sys 0m0.000s
real 0m0.811s
user 0m0.000s
sys 0m0.001s
real 0m0.635s
user 0m0.000s
sys 0m0.001s
real 0m0.666s
user 0m0.000s
sys 0m0.003s
real 0m0.761s
user 0m0.000s
sys 0m0.001s
real 0m0.631s
user 0m0.000s
sys 0m0.002s
real 0m0.769s
user 0m0.000s
sys 0m0.002s
real 0m0.665s
user 0m0.000s
sys 0m0.001s
real 0m0.343s
user 0m0.000s
sys 0m0.002s
real 0m0.359s
user 0m0.000s
sys 0m0.001s
real 0m0.644s
user 0m0.000s
sys 0m0.001s
real 0m0.279s
user 0m0.000s
sys 0m0.001s
real 0m0.344s
user 0m0.000s
sys 0m0.002s
real 0m0.620s
user 0m0.000s
sys 0m0.001s
real 0m0.714s
user 0m0.001s
sys 0m0.003s
real 0m0.651s
user 0m0.000s
sys 0m0.001s
real 0m0.672s
user 0m0.000s
sys 0m0.000s
real 0m0.272s
user 0m0.001s
sys 0m0.001s
real 0m0.601s
user 0m0.000s
sys 0m0.003s
real 0m0.272s
user 0m0.000s
sys 0m0.001s
real 0m0.759s
user 0m0.000s
sys 0m0.002s
real 0m0.648s
user 0m0.000s
sys 0m0.001s
real 0m0.280s
user 0m0.000s
sys 0m0.001s
real 0m0.782s
user 0m0.000s
sys 0m0.001s
real 0m2.272s
user 0m0.000s
sys 0m0.002s
real 0m0.275s
user 0m0.000s
sys 0m0.001s
real 0m0.388s
user 0m0.000s
sys 0m0.003s
real 0m0.274s
user 0m0.000s
sys 0m0.001s
real 0m0.275s
user 0m0.000s
sys 0m0.001s
real 0m0.663s
user 0m0.000s
sys 0m0.001s
real 0m0.667s
user 0m0.000s
sys 0m0.000s
real 0m0.643s
user 0m0.001s
sys 0m0.000s
real 0m0.643s
user 0m0.000s
sys 0m0.001s
real 0m0.660s
user 0m0.000s
sys 0m0.000s
real 0m0.276s
user 0m0.000s
sys 0m0.000s
real 0m0.548s
user 0m0.000s
sys 0m0.001s
real 0m0.704s
user 0m0.000s
sys 0m0.001s
real 0m0.751s
user 0m0.000s
sys 0m0.000s
real 0m0.673s
user 0m0.000s
sys 0m0.001s
real 0m0.647s
user 0m0.001s
sys 0m0.001s
real 0m0.642s
user 0m0.000s
sys 0m0.001s
real 0m0.662s
user 0m0.000s
sys 0m0.001s
real 0m0.626s
user 0m0.000s
sys 0m0.002s
real 0m2.024s
user 0m0.001s
sys 0m0.000s
real 0m0.641s
user 0m0.000s
sys 0m0.002s
real 0m0.609s
user 0m0.000s
sys 0m0.002s
real 0m0.586s
user 0m0.000s
sys 0m0.002s
real 0m0.667s
user 0m0.000s
sys 0m0.000s
real 0m0.652s
user 0m0.000s
sys 0m0.001s
real 0m0.670s
user 0m0.000s
sys 0m0.003s
real 0m0.340s
user 0m0.000s
sys 0m0.001s
real 0m0.538s
user 0m0.000s
sys 0m0.002s
real 0m0.305s
user 0m0.000s
sys 0m0.000s
real 0m0.547s
user 0m0.000s
sys 0m0.002s
real 0m0.605s
user 0m0.001s
sys 0m0.001s
real 0m0.291s
user 0m0.000s
sys 0m0.002s
real 0m0.344s
user 0m0.000s
sys 0m0.002s
real 0m0.340s
user 0m0.000s
sys 0m0.002s
real 0m0.299s
user 0m0.000s
sys 0m0.000s
real 0m0.328s
user 0m0.000s
sys 0m0.001s
real 0m0.662s
user 0m0.000s
sys 0m0.001s
real 0m0.336s
user 0m0.001s
sys 0m0.001s
real 0m0.632s
user 0m0.000s
sys 0m0.001s
real 0m0.341s
user 0m0.000s
sys 0m0.001s
real 0m0.622s
user 0m0.001s
sys 0m0.001s
real 0m0.719s
user 0m0.000s
sys 0m0.001s
real 0m0.722s
user 0m0.000s
sys 0m0.002s
real 0m0.667s
user 0m0.000s
sys 0m0.002s
real 0m0.773s
user 0m0.000s
sys 0m0.000s
real 0m0.761s
user 0m0.001s
sys 0m0.001s
real 0m0.277s
user 0m0.000s
sys 0m0.000s
real 0m0.585s
user 0m0.001s
sys 0m0.001s
real 0m0.351s
user 0m0.000s
sys 0m0.001s
real 0m0.656s
user 0m0.000s
sys 0m0.003s
real 0m0.593s
user 0m0.000s
sys 0m0.000s
real 0m0.274s
user 0m0.000s
sys 0m0.001s
real 0m0.305s
user 0m0.000s
sys 0m0.001s
real 0m0.279s
user 0m0.000s
sys 0m0.001s
real 0m0.339s
user 0m0.001s
sys 0m0.001s
real 0m0.677s
user 0m0.000s
sys 0m0.002s
real 0m0.749s
user 0m0.000s
sys 0m0.001s
real 0m0.714s
user 0m0.000s
sys 0m0.000s
real 0m0.649s
user 0m0.000s
sys 0m0.001s
real 0m0.347s
user 0m0.000s
sys 0m0.002s
real 0m0.271s
user 0m0.001s
sys 0m0.001s
real 0m0.636s
user 0m0.001s
sys 0m0.000s
real 0m0.706s
user 0m0.000s
sys 0m0.001s
real 0m0.696s
user 0m0.000s
sys 0m0.002s
real 0m0.272s
user 0m0.000s
sys 0m0.001s
real 0m0.278s
user 0m0.000s
sys 0m0.002s
real 0m0.347s
user 0m0.000s
sys 0m0.000s
real 0m0.274s
user 0m0.000s
sys 0m0.002s
real 0m0.669s
user 0m0.000s
sys 0m0.001s
real 0m0.348s
user 0m0.000s
sys 0m0.001s
real 0m0.661s
user 0m0.000s
sys 0m0.001s
real 0m0.613s
user 0m0.000s
sys 0m0.001s
real 0m0.384s
user 0m0.000s
sys 0m0.001s
real 0m0.723s
user 0m0.001s
sys 0m0.000s
real 0m0.650s
user 0m0.000s
sys 0m0.001s
real 0m0.366s
user 0m0.001s
sys 0m0.000s
real 0m1.843s
user 0m0.000s
sys 0m0.002s
real 0m0.522s
user 0m0.000s
sys 0m0.000s
real 0m0.343s
user 0m0.000s
sys 0m0.000s
real 0m0.675s
user 0m0.000s
sys 0m0.001s
real 0m0.950s
user 0m0.000s
sys 0m0.002s
real 0m0.022s
user 0m0.000s
sys 0m0.001s
real 0m0.400s
user 0m0.000s
sys 0m0.002s
real 0m0.016s
user 0m0.000s
sys 0m0.002s
real 0m0.342s
user 0m0.000s
sys 0m0.001s
real 0m0.700s
user 0m0.000s
sys 0m0.001s
real 0m0.610s
user 0m0.001s
sys 0m0.001s
real 0m0.652s
user 0m0.001s
sys 0m0.001s
real 0m0.606s
user 0m0.000s
sys 0m0.001s
real 0m1.905s
user 0m0.001s
sys 0m0.002s
real 0m0.583s
user 0m0.000s
sys 0m0.000s
real 0m1.352s
user 0m0.000s
sys 0m0.002s
real 0m0.791s
user 0m0.000s
sys 0m0.000s
real 0m0.719s
user 0m0.001s
sys 0m0.000s
real 0m0.651s
user 0m0.001s
sys 0m0.001s
real 0m1.147s
user 0m0.001s
sys 0m0.002s
real 0m0.627s
user 0m0.001s
sys 0m0.000s
real 0m0.289s
user 0m0.000s
sys 0m0.001s
real 0m0.355s
user 0m0.001s
sys 0m0.000s
real 0m0.431s
user 0m0.000s
sys 0m0.002s
real 0m0.642s
user 0m0.000s
sys 0m0.001s
real 0m0.631s
user 0m0.000s
sys 0m0.001s
real 0m0.666s
user 0m0.000s
sys 0m0.003s
real 0m1.122s
user 0m0.000s
sys 0m0.002s
real 0m0.371s
user 0m0.000s
sys 0m0.001s
real 0m0.651s
user 0m0.001s
sys 0m0.000s
real 0m0.597s
user 0m0.000s
sys 0m0.000s
real 0m0.948s
user 0m0.001s
sys 0m0.001s
real 0m0.609s
user 0m0.000s
sys 0m0.001s
real 0m0.734s
user 0m0.000s
sys 0m0.001s
real 0m0.530s
user 0m0.001s
sys 0m0.002s
real 0m0.269s
user 0m0.001s
sys 0m0.000s
real 0m0.714s
user 0m0.000s
sys 0m0.001s
real 0m0.658s
user 0m0.000s
sys 0m0.003s
real 0m0.484s
user 0m0.001s
sys 0m0.000s
real 0m0.951s
user 0m0.000s
sys 0m0.001s
real 0m0.671s
user 0m0.000s
sys 0m0.001s
real 0m1.047s
user 0m0.000s
sys 0m0.003s
real 0m0.768s
user 0m0.000s
sys 0m0.001s
real 0m0.813s
user 0m0.000s
sys 0m0.000s
real 0m0.567s
user 0m0.000s
sys 0m0.001s
real 0m0.629s
user 0m0.000s
sys 0m0.001s
real 0m0.671s
user 0m0.001s
sys 0m0.001s
real 0m0.724s
user 0m0.000s
sys 0m0.001s
real 0m0.665s
user 0m0.000s
sys 0m0.001s
real 0m0.330s
user 0m0.001s
sys 0m0.001s
real 0m0.530s
user 0m0.000s
sys 0m0.001s
real 0m0.342s
user 0m0.001s
sys 0m0.001s
real 0m1.202s
user 0m0.001s
sys 0m0.000s
real 0m0.587s
user 0m0.000s
sys 0m0.001s
real 0m0.632s
user 0m0.001s
sys 0m0.001s
real 0m0.708s
user 0m0.000s
sys 0m0.000s
real 0m0.593s
user 0m0.000s
sys 0m0.001s
real 0m0.671s
user 0m0.000s
sys 0m0.003s
real 0m1.088s
user 0m0.000s
sys 0m0.001s
real 0m1.389s
user 0m0.000s
sys 0m0.001s
real 0m0.715s
user 0m0.000s
sys 0m0.002s
real 0m0.638s
user 0m0.001s
sys 0m0.001s
real 0m0.587s
user 0m0.000s
sys 0m0.002s
real 0m1.537s
user 0m0.001s
sys 0m0.000s
real 0m0.781s
user 0m0.000s
sys 0m0.000s
real 0m0.862s
user 0m0.000s
sys 0m0.002s
real 0m1.018s
user 0m0.000s
sys 0m0.002s
real 0m1.076s
user 0m0.000s
sys 0m0.002s
real 0m0.771s
user 0m0.000s
sys 0m0.001s
real 0m0.653s
user 0m0.001s
sys 0m0.000s
real 0m1.081s
user 0m0.000s
sys 0m0.002s
real 0m0.913s
user 0m0.000s
sys 0m0.001s
real 0m0.717s
user 0m0.000s
sys 0m0.001s
real 0m0.662s
user 0m0.001s
sys 0m0.000s
real 0m0.330s
user 0m0.000s
sys 0m0.002s
real 0m0.355s
user 0m0.000s
sys 0m0.001s
real 0m0.656s
user 0m0.000s
sys 0m0.001s
real 0m0.821s
user 0m0.002s
sys 0m0.000s
real 0m0.624s
user 0m0.000s
sys 0m0.003s
real 0m0.599s
user 0m0.000s
sys 0m0.000s
real 0m0.560s
user 0m0.000s
sys 0m0.000s
real 0m0.612s
user 0m0.000s
sys 0m0.002s
real 0m0.586s
user 0m0.000s
sys 0m0.001s
real 0m0.801s
user 0m0.002s
sys 0m0.000s
real 0m0.475s
user 0m0.000s
sys 0m0.001s
real 0m0.269s
user 0m0.000s
sys 0m0.002s
real 0m0.678s
user 0m0.000s
sys 0m0.002s
real 0m0.667s
user 0m0.000s
sys 0m0.001s
real 0m0.706s
user 0m0.000s
sys 0m0.001s
real 0m0.677s
user 0m0.000s
sys 0m0.001s
real 0m0.551s
user 0m0.000s
sys 0m0.002s
real 0m0.641s
user 0m0.000s
sys 0m0.002s
real 0m0.708s
user 0m0.000s
sys 0m0.002s
real 0m0.338s
user 0m0.000s
sys 0m0.001s
real 0m1.122s
user 0m0.000s
sys 0m0.002s
real 0m0.772s
user 0m0.000s
sys 0m0.001s
real 0m0.017s
user 0m0.000s
sys 0m0.002s
real 0m1.197s
user 0m0.000s
sys 0m0.001s
real 0m1.388s
user 0m0.000s
sys 0m0.003s
real 0m0.825s
user 0m0.000s
sys 0m0.002s
real 0m0.647s
user 0m0.001s
sys 0m0.000s
real 0m0.559s
user 0m0.000s
sys 0m0.002s
real 0m0.664s
user 0m0.000s
sys 0m0.000s
real 0m0.544s
user 0m0.000s
sys 0m0.002s
real 0m0.646s
user 0m0.000s
sys 0m0.001s
real 0m0.581s
user 0m0.000s
sys 0m0.001s
real 0m0.392s
user 0m0.000s
sys 0m0.001s
real 0m1.338s
user 0m0.000s
sys 0m0.001s
real 0m0.608s
user 0m0.001s
sys 0m0.001s
real 0m0.957s
user 0m0.000s
sys 0m0.001s
real 0m0.343s
user 0m0.000s
sys 0m0.000s
[root@fatcompute-11-32 orangefs]#
[root@fatcompute-11-32 orangefs]# for i in myfile*; do time rm -f ${i}; done
...
real 0m0.045s
user 0m0.000s
sys 0m0.001s
real 0m0.017s
user 0m0.000s
sys 0m0.001s
real 0m0.287s
user 0m0.000s
sys 0m0.001s
real 0m0.017s
user 0m0.002s
sys 0m0.001s
real 0m0.717s
user 0m0.000s
sys 0m0.001s
real 0m0.047s
user 0m0.002s
sys 0m0.000s
real 0m0.017s
user 0m0.000s
sys 0m0.000s
real 0m0.016s
user 0m0.000s
sys 0m0.001s
real 0m0.018s
user 0m0.000s
sys 0m0.001s
real 0m1.128s
user 0m0.000s
sys 0m0.001s
real 0m0.052s
user 0m0.000s
sys 0m0.002s
real 0m0.017s
user 0m0.000s
sys 0m0.000s
real 0m0.016s
user 0m0.000s
sys 0m0.002s
real 0m0.017s
user 0m0.000s
sys 0m0.001s
real 0m1.013s
user 0m0.000s
sys 0m0.000s
real 0m0.026s
user 0m0.000s
sys 0m0.002s
real 0m1.238s
user 0m0.000s
sys 0m0.002s
real 0m0.018s
user 0m0.000s
sys 0m0.001s
real 0m1.064s
user 0m0.000s
sys 0m0.001s
real 0m0.416s
user 0m0.001s
sys 0m0.002s
real 0m0.894s
user 0m0.001s
sys 0m0.001s
real 0m0.805s
user 0m0.000s
sys 0m0.001s
real 0m0.017s
user 0m0.000s
sys 0m0.002s
real 0m0.878s
user 0m0.000s
sys 0m0.001s
real 0m1.503s
user 0m0.000s
sys 0m0.003s
real 0m0.019s
user 0m0.000s
sys 0m0.002s
real 0m0.789s
user 0m0.000s
sys 0m0.002s
real 0m0.658s
user 0m0.000s
sys 0m0.001s
real 0m1.171s
user 0m0.001s
sys 0m0.001s
real 0m0.060s
user 0m0.001s
sys 0m0.000s
real 0m1.337s
user 0m0.000s
sys 0m0.002s
real 0m1.342s
user 0m0.000s
sys 0m0.002s
real 0m1.052s
user 0m0.000s
sys 0m0.002s
real 0m0.018s
user 0m0.001s
sys 0m0.001s
real 0m0.016s
user 0m0.000s
sys 0m0.001s
real 0m0.017s
user 0m0.001s
sys 0m0.000s
real 0m0.017s
user 0m0.000s
sys 0m0.001s
real 0m0.838s
user 0m0.000s
sys 0m0.001s
real 0m0.036s
user 0m0.000s
sys 0m0.001s
real 0m0.016s
user 0m0.000s
sys 0m0.001s
real 0m0.016s
user 0m0.000s
sys 0m0.002s
real 0m0.016s
user 0m0.000s
sys 0m0.002s
real 0m0.017s
user 0m0.000s
sys 0m0.001s
real 0m0.018s
user 0m0.001s
sys 0m0.000s
real 0m0.017s
user 0m0.001s
sys 0m0.001s
real 0m0.016s
user 0m0.000s
sys 0m0.001s
real 0m0.016s
user 0m0.000s
sys 0m0.000s
real 0m0.812s
user 0m0.001s
sys 0m0.001s
real 0m0.820s
user 0m0.000s
sys 0m0.002s
real 0m0.018s
user 0m0.000s
sys 0m0.001s
real 0m1.165s
user 0m0.000s
sys 0m0.001s
real 0m0.074s
user 0m0.001s
sys 0m0.000s
real 0m0.017s
user 0m0.000s
sys 0m0.001s
real 0m0.974s
user 0m0.001s
sys 0m0.001s
real 0m0.018s
user 0m0.001s
sys 0m0.000s
real 0m1.206s
user 0m0.000s
sys 0m0.001s
real 0m0.018s
user 0m0.000s
sys 0m0.002s
real 0m1.133s
user 0m0.000s
sys 0m0.001s
real 0m0.934s
user 0m0.000s
sys 0m0.000s
real 0m0.024s
user 0m0.000s
sys 0m0.001s
real 0m0.017s
user 0m0.000s
sys 0m0.000s
real 0m0.787s
user 0m0.000s
sys 0m0.000s
real 0m1.272s
user 0m0.000s
sys 0m0.001s
real 0m0.017s
user 0m0.001s
sys 0m0.000s
real 0m0.017s
user 0m0.000s
sys 0m0.001s
real 0m0.017s
user 0m0.000s
sys 0m0.001s
real 0m1.202s
user 0m0.000s
sys 0m0.002s
real 0m1.241s
user 0m0.000s
sys 0m0.002s
real 0m0.017s
user 0m0.000s
sys 0m0.002s
real 0m0.016s
user 0m0.000s
sys 0m0.001s
real 0m0.017s
user 0m0.000s
sys 0m0.000s
real 0m1.169s
user 0m0.000s
sys 0m0.001s
real 0m1.227s
user 0m0.000s
sys 0m0.001s
real 0m0.018s
user 0m0.000s
sys 0m0.001s
real 0m0.016s
user 0m0.000s
sys 0m0.001s
real 0m0.594s
user 0m0.000s
sys 0m0.001s
real 0m1.202s
user 0m0.000s
sys 0m0.001s
real 0m0.017s
user 0m0.000s
sys 0m0.002s
real 0m0.017s
user 0m0.000s
sys 0m0.001s
real 0m0.017s
user 0m0.000s
sys 0m0.001s
real 0m0.017s
user 0m0.000s
sys 0m0.001s
real 0m0.017s
user 0m0.000s
sys 0m0.001s
real 0m0.908s
user 0m0.000s
sys 0m0.001s
real 0m0.018s
user 0m0.000s
sys 0m0.001s
real 0m0.016s
user 0m0.001s
sys 0m0.002s
real 0m0.016s
user 0m0.000s
sys 0m0.001s
real 0m0.017s
user 0m0.000s
sys 0m0.001s
real 0m0.017s
user 0m0.000s
sys 0m0.000s
real 0m0.017s
user 0m0.000s
sys 0m0.001s
real 0m0.017s
user 0m0.000s
sys 0m0.000s
real 0m0.017s
user 0m0.001s
sys 0m0.001s
real 0m0.016s
user 0m0.000s
sys 0m0.000s
real 0m0.603s
user 0m0.000s
sys 0m0.001s
real 0m0.072s
user 0m0.002s
sys 0m0.000s
real 0m0.017s
user 0m0.000s
sys 0m0.001s
real 0m0.016s
user 0m0.000s
sys 0m0.001s
real 0m0.017s
user 0m0.000s
sys 0m0.001s
real 0m0.016s
user 0m0.000s
sys 0m0.001s
real 0m0.017s
user 0m0.000s
sys 0m0.001s
real 0m0.622s
user 0m0.000s
sys 0m0.001s
real 0m0.018s
user 0m0.000s
sys 0m0.001s
real 0m0.017s
user 0m0.000s
sys 0m0.001s
real 0m0.017s
user 0m0.000s
sys 0m0.000s
real 0m0.610s
user 0m0.000s
sys 0m0.002s
real 0m0.018s
user 0m0.001s
sys 0m0.000s
real 0m0.466s
user 0m0.001s
sys 0m0.001s
real 0m0.018s
user 0m0.000s
sys 0m0.001s
real 0m0.016s
user 0m0.000s
sys 0m0.001s
real 0m0.016s
user 0m0.000s
sys 0m0.000s
real 0m0.711s
user 0m0.000s
sys 0m0.000s
real 0m0.018s
user 0m0.000s
sys 0m0.001s
real 0m0.017s
user 0m0.000s
sys 0m0.000s
real 0m0.017s
user 0m0.001s
sys 0m0.001s
real 0m0.017s
user 0m0.000s
sys 0m0.001s
real 0m0.991s
user 0m0.000s
sys 0m0.001s
real 0m0.019s
user 0m0.000s
sys 0m0.002s
real 0m0.016s
user 0m0.000s
sys 0m0.001s
real 0m0.884s
user 0m0.001s
sys 0m0.000s
real 0m1.212s
user 0m0.000s
sys 0m0.001s
real 0m0.018s
user 0m0.000s
sys 0m0.002s
real 0m0.016s
user 0m0.000s
sys 0m0.002s
real 0m0.947s
user 0m0.000s
sys 0m0.001s
real 0m0.017s
user 0m0.000s
sys 0m0.002s
real 0m0.018s
user 0m0.000s
sys 0m0.001s
real 0m0.018s
user 0m0.000s
sys 0m0.002s
real 0m0.617s
user 0m0.000s
sys 0m0.000s
real 0m0.017s
user 0m0.000s
sys 0m0.002s
real 0m0.017s
user 0m0.000s
sys 0m0.000s
real 0m0.017s
user 0m0.000s
sys 0m0.001s
real 0m0.016s
user 0m0.000s
sys 0m0.002s
real 0m0.830s
user 0m0.000s
sys 0m0.001s
real 0m0.977s
user 0m0.001s
sys 0m0.002s
real 0m0.042s
user 0m0.000s
sys 0m0.000s
real 0m0.017s
user 0m0.000s
sys 0m0.002s
real 0m1.038s
user 0m0.001s
sys 0m0.001s
real 0m0.017s
user 0m0.000s
sys 0m0.001s
real 0m0.940s
user 0m0.000s
sys 0m0.002s
real 0m0.018s
user 0m0.000s
sys 0m0.001s
real 0m0.016s
user 0m0.000s
sys 0m0.002s
real 0m0.017s
user 0m0.000s
sys 0m0.001s
real 0m0.017s
user 0m0.000s
sys 0m0.000s
real 0m0.017s
user 0m0.000s
sys 0m0.002s
real 0m0.016s
user 0m0.000s
sys 0m0.001s
real 0m0.017s
user 0m0.000s
sys 0m0.001s
real 0m0.017s
user 0m0.000s
sys 0m0.001s
real 0m0.016s
user 0m0.001s
sys 0m0.000s
real 0m1.121s
user 0m0.000s
sys 0m0.000s
real 0m0.594s
user 0m0.000s
sys 0m0.001s
real 0m0.083s
user 0m0.000s
sys 0m0.001s
real 0m0.016s
user 0m0.001s
sys 0m0.000s
real 0m0.016s
user 0m0.000s
sys 0m0.001s
real 0m0.016s
user 0m0.000s
sys 0m0.001s
real 0m0.550s
user 0m0.000s
sys 0m0.001s
real 0m0.848s
user 0m0.000s
sys 0m0.000s
real 0m0.017s
user 0m0.000s
sys 0m0.002s
real 0m0.017s
user 0m0.000s
sys 0m0.002s
real 0m0.017s
user 0m0.000s
sys 0m0.002s
real 0m0.017s
user 0m0.001s
sys 0m0.000s
real 0m1.074s
user 0m0.000s
sys 0m0.001s
real 0m0.073s
user 0m0.000s
sys 0m0.001s
real 0m1.041s
user 0m0.000s
sys 0m0.002s
real 0m0.722s
user 0m0.000s
sys 0m0.002s
real 0m0.911s
user 0m0.000s
sys 0m0.002s
real 0m0.017s
user 0m0.000s
sys 0m0.002s
real 0m0.017s
user 0m0.000s
sys 0m0.001s
real 0m0.017s
user 0m0.000s
sys 0m0.001s
real 0m0.961s
user 0m0.000s
sys 0m0.001s
real 0m0.571s
user 0m0.001s
sys 0m0.001s
real 0m0.017s
user 0m0.000s
sys 0m0.001s
real 0m0.017s
user 0m0.000s
sys 0m0.001s
real 0m0.623s
user 0m0.000s
sys 0m0.000s
real 0m0.017s
user 0m0.000s
sys 0m0.001s
real 0m0.016s
user 0m0.000s
sys 0m0.001s
real 0m0.833s
user 0m0.000s
sys 0m0.000s
real 0m0.018s
user 0m0.000s
sys 0m0.001s
real 0m0.016s
user 0m0.000s
sys 0m0.001s
real 0m0.018s
user 0m0.000s
sys 0m0.001s
real 0m0.346s
user 0m0.000s
sys 0m0.000s
real 0m0.019s
user 0m0.000s
sys 0m0.001s
real 0m0.608s
user 0m0.001s
sys 0m0.000s
real 0m1.059s
user 0m0.000s
sys 0m0.001s
real 0m0.420s
user 0m0.000s
sys 0m0.002s
real 0m0.017s
user 0m0.000s
sys 0m0.001s
real 0m0.016s
user 0m0.000s
sys 0m0.000s
real 0m0.017s
user 0m0.000s
sys 0m0.000s
real 0m0.016s
user 0m0.000s
sys 0m0.001s
real 0m0.016s
user 0m0.000s
sys 0m0.001s
real 0m0.411s
user 0m0.000s
sys 0m0.001s
real 0m0.614s
user 0m0.000s
sys 0m0.002s
real 0m0.018s
user 0m0.000s
sys 0m0.000s
real 0m0.018s
user 0m0.000s
sys 0m0.001s
real 0m0.017s
user 0m0.000s
sys 0m0.001s
real 0m0.559s
user 0m0.000s
sys 0m0.002s
real 0m0.039s
user 0m0.000s
sys 0m0.000s
real 0m0.529s
user 0m0.000s
sys 0m0.000s
real 0m0.390s
user 0m0.000s
sys 0m0.002s
real 0m0.841s
user 0m0.001s
sys 0m0.000s
real 0m0.885s
user 0m0.001s
sys 0m0.001s
real 0m0.017s
user 0m0.000s
sys 0m0.001s
real 0m0.016s
user 0m0.001s
sys 0m0.000s
real 0m0.017s
user 0m0.000s
sys 0m0.000s
real 0m0.017s
user 0m0.000s
sys 0m0.002s
real 0m0.016s
user 0m0.001s
sys 0m0.000s
real 0m0.016s
user 0m0.000s
sys 0m0.001s
real 0m1.076s
user 0m0.002s
sys 0m0.000s
real 0m0.017s
user 0m0.000s
sys 0m0.000s
real 0m0.826s
user 0m0.000s
sys 0m0.000s
real 0m0.018s
user 0m0.000s
sys 0m0.001s
real 0m0.678s
user 0m0.001s
sys 0m0.000s
real 0m0.016s
user 0m0.000s
sys 0m0.001s
real 0m0.016s
user 0m0.001s
sys 0m0.000s
real 0m0.016s
user 0m0.000s
sys 0m0.000s
real 0m0.943s
user 0m0.000s
sys 0m0.001s
real 0m0.780s
user 0m0.000s
sys 0m0.000s
real 0m0.018s
user 0m0.000s
sys 0m0.002s
real 0m0.017s
user 0m0.000s
sys 0m0.001s
real 0m0.378s
user 0m0.000s
sys 0m0.001s
real 0m0.018s
user 0m0.000s
sys 0m0.002s
real 0m0.737s
user 0m0.000s
sys 0m0.003s
real 0m0.036s
user 0m0.000s
sys 0m0.001s
real 0m0.016s
user 0m0.000s
sys 0m0.000s
real 0m0.017s
user 0m0.000s
sys 0m0.001s
real 0m0.389s
user 0m0.001s
sys 0m0.000s
real 0m0.019s
user 0m0.001s
sys 0m0.001s
real 0m0.780s
user 0m0.000s
sys 0m0.001s
real 0m0.022s
user 0m0.000s
sys 0m0.002s
real 0m0.017s
user 0m0.000s
sys 0m0.000s
real 0m0.458s
user 0m0.000s
sys 0m0.003s
real 0m0.017s
user 0m0.000s
sys 0m0.001s
real 0m0.701s
user 0m0.000s
sys 0m0.001s
real 0m0.017s
user 0m0.000s
sys 0m0.001s
real 0m0.016s
user 0m0.000s
sys 0m0.001s
real 0m0.017s
user 0m0.000s
sys 0m0.002s
real 0m0.017s
user 0m0.000s
sys 0m0.001s
real 0m0.016s
user 0m0.000s
sys 0m0.001s
real 0m0.017s
user 0m0.000s
sys 0m0.001s
real 0m0.016s
user 0m0.000s
sys 0m0.001s
real 0m0.018s
user 0m0.000s
sys 0m0.001s
real 0m0.017s
user 0m0.001s
sys 0m0.000s
real 0m0.017s
user 0m0.001s
sys 0m0.000s
real 0m0.016s
user 0m0.000s
sys 0m0.001s
real 0m0.016s
user 0m0.000s
sys 0m0.001s
real 0m0.678s
user 0m0.000s
sys 0m0.000s
real 0m0.085s
user 0m0.000s
sys 0m0.001s
real 0m0.018s
user 0m0.000s
sys 0m0.000s
real 0m0.016s
user 0m0.000s
sys 0m0.001s
real 0m0.900s
user 0m0.000s
sys 0m0.001s
real 0m0.018s
user 0m0.000s
sys 0m0.001s
real 0m0.017s
user 0m0.000s
sys 0m0.001s
real 0m0.669s
user 0m0.000s
sys 0m0.000s
real 0m0.017s
user 0m0.000s
sys 0m0.000s
real 0m0.016s
user 0m0.000s
sys 0m0.001s
real 0m0.017s
user 0m0.000s
sys 0m0.000s
real 0m0.017s
user 0m0.000s
sys 0m0.000s
real 0m0.017s
user 0m0.000s
sys 0m0.002s
real 0m0.017s
user 0m0.000s
sys 0m0.001s
real 0m0.018s
user 0m0.000s
sys 0m0.000s
real 0m0.017s
user 0m0.000s
sys 0m0.001s
real 0m0.017s
user 0m0.000s
sys 0m0.000s
real 0m0.869s
user 0m0.000s
sys 0m0.001s
real 0m0.679s
user 0m0.000s
sys 0m0.000s
real 0m0.016s
user 0m0.001s
sys 0m0.000s
real 0m0.016s
user 0m0.000s
sys 0m0.000s
real 0m0.017s
user 0m0.000s
sys 0m0.000s
real 0m0.018s
user 0m0.000s
sys 0m0.001s
[root@fatcompute-11-32 orangefs]#
smime.p7s
Description: S/MIME Cryptographic Signature
_______________________________________________ Pvfs2-users mailing list [email protected] http://www.beowulf-underground.org/mailman/listinfo/pvfs2-users
