Re: [Hdf-forum] Concurrent HDF5 access crashes wsgi server (even with --enable-threadsafe)

[Elena Pourmal]

Yoshua,

Would it be possible for you to reproduce the issue using C application and 
submit it to h...@hdfgorup.org?

Thank you!

Elena


On Jul 12, 2016, at 11:34 PM, Yoshua Wakeham 
mailto:wakeha...@wehi.edu.au>> wrote:

Hi there,

I'm using HDF5 files as a data storage format for a low-traffic web 
application, which is built in Pyramid (Python framework) and running on the 
Waitress WSGI server. We have encountered a nasty bug where if multiple 
requests (threads) concurrently read different HDF5 files, the server crashes 
with a segmentation fault. The crash is definitely thread-related, because the 
bug vanishes if we restrict the server to be single-threaded.

Note that the crash does not occur when multiple threads read the *same* HDF5 
file. Only when multiple HDF5 files are being accessed simultaneously.

We have built libhdf5 (version 1.8.16) with --enable-threadsafe turned on; the 
ttsafe tests run successfully.

Any help in resolving the bug would be much appreciated.

Best regards,
Yoshua Wakeham
__

The information in this email is confidential and intended solely for the 
addressee.
You must not disclose, forward, print or use it without the permission of the 
sender.
__


___
Hdf-forum is for HDF software users discussion.
Hdf-forum@lists.hdfgroup.org
http://lists.hdfgroup.org/mailman/listinfo/hdf-forum_lists.hdfgroup.org
Twitter: https://twitter.com/hdf5

___
Hdf-forum is for HDF software users discussion.
Hdf-forum@lists.hdfgroup.org
http://lists.hdfgroup.org/mailman/listinfo/hdf-forum_lists.hdfgroup.org
Twitter: https://twitter.com/hdf5

Re: [Hdf-forum] H5Pset_virtual_source_path

[Elena Pourmal]

Hi Jarom,

The function was not implemented. We will try to address the issue in the 
release later this year.

Elena
On Jul 13, 2016, at 11:37 AM, Nelson, Jarom 
mailto:nelso...@llnl.gov>> wrote:

The RFC for the virtual datasets indicates that you can set a path in which to 
search for the source files referenced in the virtual datasets, using the 
H5Pset_virtual_source_path function. It doesn’t appear that this was 
implemented, as my header files don’t resolve that symbol. Am I just missing 
something?

At the moment, I’m using just the base filename as the source file, and h5dump 
(1.10.0 patch 1) works fine if my working directory is the same as the VDS file 
(collocated with the source files), but fails to resolve the data if I dump it 
from a different directory.

What I would like to do is have the HDF library search in “.” relative to the 
location of the VDS file.

Jarom Nelson

___
Hdf-forum is for HDF software users discussion.
Hdf-forum@lists.hdfgroup.org
http://lists.hdfgroup.org/mailman/listinfo/hdf-forum_lists.hdfgroup.org
Twitter: https://twitter.com/hdf5

___
Hdf-forum is for HDF software users discussion.
Hdf-forum@lists.hdfgroup.org
http://lists.hdfgroup.org/mailman/listinfo/hdf-forum_lists.hdfgroup.org
Twitter: https://twitter.com/hdf5

Re: [Hdf-forum] h5copy, segmentation fault

[Elena Pourmal]

Hi Jilian,

No idea. Could you please send the file to 
h...@hdfgroup.org along with the h5copy command used?

Thank you!

Elena
On Jul 14, 2016, at 4:09 PM, Jialin Liu 
mailto:jaln...@lbl.gov>> wrote:

Hi,
I’m using the h5copy to convert an netcdf file to hdf5, it returns segmentation 
fault, the file size is 24G,
the specific dataset that i tried to convert is H5T_STD_I16LE and ( 1617, 4320, 
8640).

Any idea about this error? Thanks,

Best,
Jialin
___
Hdf-forum is for HDF software users discussion.
Hdf-forum@lists.hdfgroup.org
http://lists.hdfgroup.org/mailman/listinfo/hdf-forum_lists.hdfgroup.org
Twitter: https://twitter.com/hdf5

___
Hdf-forum is for HDF software users discussion.
Hdf-forum@lists.hdfgroup.org
http://lists.hdfgroup.org/mailman/listinfo/hdf-forum_lists.hdfgroup.org
Twitter: https://twitter.com/hdf5

[Hdf-forum] h5copy, segmentation fault

[Jialin Liu]

Hi, 
I’m using the h5copy to convert an netcdf file to hdf5, it returns segmentation 
fault, the file size is 24G, 
the specific dataset that i tried to convert is H5T_STD_I16LE and ( 1617, 4320, 
8640).

Any idea about this error? Thanks, 

Best,
Jialin___
Hdf-forum is for HDF software users discussion.
Hdf-forum@lists.hdfgroup.org
http://lists.hdfgroup.org/mailman/listinfo/hdf-forum_lists.hdfgroup.org
Twitter: https://twitter.com/hdf5