Hello,
Has anyone seen a problem like this? We are writing data at 1KHz that
is set up like this:
HDF5 "201604121356.ovms.opd_estimation_mode2.h5" {
DATASET "opd_estimation_mode2_01" {
DATATYPE H5T_COMPOUND {
H5T_STD_I64LE "time_stamp";
H5T_STD_I32LE "tai_offset";
H5T_IEEE_F32LE "sx_x_fp";
H5T_IEEE_F32LE "sx_y_fp";
H5T_IEEE_F32LE "dx_x_fp";
H5T_IEEE_F32LE "dx_y_fp";
H5T_IEEE_F32LE "diff_z_fp";
H5T_IEEE_F32LE "predict_horiz";
}
In a CentOS environment using hdf5 1.9.131 and IDL 1.8. We have scripts
for reading the HDF5 files. Typically a python script identifies the .h5
files to be read, and then spawns an IDL process to read them and make a
plot. Typically reading a 100M .h5 telemetry files take about 30
sec. The problem is that every 20th time or so, the IDL process is
getting "stuck" and uses 100% CPU until we kill it. This only happens
for IDL reading .h5 files, and never for the cases where the python
script makes a large .csv which is read by IDL. It doesn't matter if
the .h5 file is being actively written to, or if the file is weeks old.
When running from the IDL command line, to see the print statements, it
seems to hang on the H5D_READ call. Sometimes it will hang repeatedly
on the same data file, sometimes it works on the same file, without hanging.
I am going to try to attach to it with strace the next time I see it,
but I was wondering if someone else has seen something similar?
Thanks
_______________________________________________
Hdf-forum is for HDF software users discussion.
[email protected]
http://lists.hdfgroup.org/mailman/listinfo/hdf-forum_lists.hdfgroup.org
Twitter: https://twitter.com/hdf5
