With the 0.9.8.8 release we've improved Hypertable stability when running on top of HDFS. In particular, we're now passing the SYNC_BLOCK flag to all file open calls and flushing METADATA commit log writes happens with hsync() instead of hflush(). To learn exactly what this means, please read the HDFS and Durability <http://hypertable.com/documentation/administrator_guide/hdfs_and_durability> section of the Hypertable Administrator's Guide.
The stability improvements have come at a cost in performance (it's more expensive to call hysync() than it is to call hflush() for example). However, we've made a number of performance improvements that should mostly offset the performance degradation introduced by the stability improvements. If after upgrading to 0.9.8.8, you're not getting adequate performance, you can can effectively roll back the performance degrading changes by adding the following two property settings to your hypertable.cfg file and restarting: HdfsBroker.SyncBlock=false Hypertable.LogFlushMethod.Meta=FLUSH - Doug -- You received this message because you are subscribed to the Google Groups "Hypertable Development" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To post to this group, send email to [email protected]. Visit this group at http://groups.google.com/group/hypertable-dev. For more options, visit https://groups.google.com/d/optout.
