Do you see there's an opportunity to enable this to optimize the production clusters you're running?
I don't have a number about isa-l performance since I'm not (seriously) using erasure coding feature.. On 2021/07/22 1:25, Evans Ye wrote:
I wonder whether this can create effective perf improvement for production workloads. Luca, Kengo, Masatake: Do you see there's an opportunity to enable this to optimize the production clusters you're running? Chad William Seys <[email protected] <mailto:[email protected]>> 於 2021年7月20日 週二 下午11:01寫道： I'm glad there was a bare metal version of the build! We're going to test HDFS packaged to be ISA-L aware installed on a cluster without the ISA-L libraries installed. If it handles this case gracefully I think it would it make sense to package ISA-L aware Hadoop. It would give Bigtop Hadoop the flexibility to use or not use ISA-L "out of the box". Not sure how to trigger ISA-L awareness other than by installing ISA-L before packaging. As mentioned in this thread there is a github repo which automates the creation of RPMs. But maybe there is a way to tell Hadoop to build with awareness without installing the ISA-L? Thanks again, Chad.
