Thanks. I do not know enough about the format of HDF5, nor the pros and cons of different indexing schemes. But for certain applications, some form of indexing would be nice. In the examples given in what I think they called “FastHDF” the range of queries of the data were much larger, and the speed of access was improved.
I also realize that a lot of what you put your resources to is what someone is willing to fund, and all I can offer is buying Ted a beer the next time I see him at a meeting. -Roy > On Apr 6, 2016, at 8:46 AM, Elena Pourmal <[email protected]> wrote: > > Hi Roy, > > On Apr 6, 2016, at 9:55 AM, Roy Mendelssohn - NOAA Federal > <[email protected]> wrote: > >> Hi Elena: >> >> A couple of years ago the HDF Group had adding this capability to HDF5 as a >> long term project. Is this still ongoing or has it been scrapped? >> > > At this point no decision was made. We have several features that were > prototyped but were never productized, and indexing is one of them. It would > take a lot of work to integrate indexing/querying feature into HDF5. It is > also not clear if this is a right approach since we would be adding a lot of > complexity to HDF5 increasing its maintenance cost. We need to evaluate other > solutions that involve existing technologies. On another hand, it would be > great to have indexing and querying in HDF5, wouldn’t it? :-) > > During this year we have to release promised HPC features (see > https://hdfgroup.org/wp/2015/05/whats-coming-in-the-hdf5-1-10-0-release/), > and we will be working on the roadmap for HDF5. Stay tuned. Input from this > FORUM would be highly appreciated as always. > > Thank you! > > Elena > > ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ > Elena Pourmal The HDF Group http://hdfgroup.org > 1800 So. Oak St., Suite 203, Champaign IL 61820 > 217.531.6112 > ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ >> Thanks, >> >> -Roy >> >>> On Apr 6, 2016, at 6:31 AM, Elena Pourmal <[email protected]> wrote: >>> >>> Mike, >>> >>> Fastbit and fastquery are not part of the HDF5 software developed and >>> maintained by The HDF Group. It comes from NERSC; see >>> https://sdm.lbl.gov/fastbit/ >>> >>> Elena >>> ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ >>> Elena Pourmal The HDF Group http://hdfgroup.org >>> 1800 So. Oak St., Suite 203, Champaign IL 61820 >>> 217.531.6112 >>> ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ >>> >>> >>> >>> >>> On Apr 5, 2016, at 4:54 PM, Mike Yang <[email protected]> wrote: >>> >>>> Hi, >>>> Can someone tell me if fastbit & fastquery is part of hdf5 official >>>> release? >>>> Any doc, tutorial, examples ? >>>> >>>> Thanks, >>>> >>>> This e-mail and its attachments are intended only for the individual or >>>> entity to whom it is addressed and may contain information that is >>>> confidential, privileged, inside information, or subject to other >>>> restrictions on use or disclosure. Any unauthorized use, dissemination or >>>> copying of this transmission or the information in it is prohibited and >>>> may be unlawful. If you have received this transmission in error, please >>>> notify the sender immediately by return e-mail, and permanently delete or >>>> destroy this e-mail, any attachments, and all copies (digital or paper). >>>> Unless expressly stated in this e-mail, nothing in this message should be >>>> construed as a digital or electronic signature. For additional important >>>> disclaimers and disclosures regarding KCG’s products and services, please >>>> click on the following link: >>>> >>>> http://www.kcg.com/legal/global-disclosures >>>> _______________________________________________ >>>> Hdf-forum is for HDF software users discussion. >>>> [email protected] >>>> http://lists.hdfgroup.org/mailman/listinfo/hdf-forum_lists.hdfgroup.org >>>> Twitter: https://twitter.com/hdf5 >>> >>> _______________________________________________ >>> Hdf-forum is for HDF software users discussion. >>> [email protected] >>> http://lists.hdfgroup.org/mailman/listinfo/hdf-forum_lists.hdfgroup.org >>> Twitter: https://twitter.com/hdf5 >> >> ********************** >> "The contents of this message do not reflect any position of the U.S. >> Government or NOAA." >> ********************** >> Roy Mendelssohn >> Supervisory Operations Research Analyst >> NOAA/NMFS >> Environmental Research Division >> Southwest Fisheries Science Center >> ***Note new address and phone*** >> 110 Shaffer Road >> Santa Cruz, CA 95060 >> Phone: (831)-420-3666 >> Fax: (831) 420-3980 >> e-mail: [email protected] www: http://www.pfeg.noaa.gov/ >> >> "Old age and treachery will overcome youth and skill." >> "From those who have been given much, much will be expected" >> "the arc of the moral universe is long, but it bends toward justice" -MLK Jr. >> >> >> _______________________________________________ >> Hdf-forum is for HDF software users discussion. >> [email protected] >> http://lists.hdfgroup.org/mailman/listinfo/hdf-forum_lists.hdfgroup.org >> Twitter: https://twitter.com/hdf5 > > > _______________________________________________ > Hdf-forum is for HDF software users discussion. > [email protected] > http://lists.hdfgroup.org/mailman/listinfo/hdf-forum_lists.hdfgroup.org > Twitter: https://twitter.com/hdf5 ********************** "The contents of this message do not reflect any position of the U.S. Government or NOAA." ********************** Roy Mendelssohn Supervisory Operations Research Analyst NOAA/NMFS Environmental Research Division Southwest Fisheries Science Center ***Note new address and phone*** 110 Shaffer Road Santa Cruz, CA 95060 Phone: (831)-420-3666 Fax: (831) 420-3980 e-mail: [email protected] www: http://www.pfeg.noaa.gov/ "Old age and treachery will overcome youth and skill." "From those who have been given much, much will be expected" "the arc of the moral universe is long, but it bends toward justice" -MLK Jr. _______________________________________________ Hdf-forum is for HDF software users discussion. [email protected] http://lists.hdfgroup.org/mailman/listinfo/hdf-forum_lists.hdfgroup.org Twitter: https://twitter.com/hdf5
