Hello, T.H.Hsieh.
You asked, "... is it possible to enable file compression on the ZFS backend
only without any side effect in the whole Lustre file system ?"
The answer is, yes. As Robert Redl explained earlier, the OST can deal with
some objects compressed and others not, even while
Dear Andreas,
Sorry for replying late. In the past days we fell into a nightmare
of upgrading a large Lustre system from version 1.8.8 directly to
version 2.10.7. Fortunately everything seems done.
Our scenario of storing large sparse data file is simple. We have
standard C code for some
On Sep 8, 2020, at 9:13 PM, Tung-Han Hsieh
wrote:
>
> I would like to ask whether Lustre file system has implemented the
> function to optimize for large sparse data files ?
>
> For example, a 3GB data file but with more than 80% bytes zero, can
> Lustre file system optimize the storage not
Dear Tung-Han,
Am 09.09.20 um 09:49 schrieb Tung-Han Hsieh:
> Dear Robert,
>
> Thank you very much for your prompt reply.
>
> I have additional questions. Since we have a large Lustre file
> system pool, some are OST with ldiskfs backend, and some are OST
> with ZFS backend. Can I just enable
Dear Robert,
Thank you very much for your prompt reply.
I have additional questions. Since we have a large Lustre file
system pool, some are OST with ldiskfs backend, and some are OST
with ZFS backend. Can I just enable compression on the ZFS backend
which is going to be joined into the Lustre
Dear Tung-Han,
you can use Lustre with ZFS backend and enabled compression. That has
the effect you are looking for and works very well.
Cheers,
Robert
Am 09.09.20 um 05:13 schrieb Tung-Han Hsieh:
> Dear All,
>
> I would like to ask whether Lustre file system has implemented the
> function to
Dear All,
I would like to ask whether Lustre file system has implemented the
function to optimize for large sparse data files ?
For example, a 3GB data file but with more than 80% bytes zero, can
Lustre file system optimize the storage not actually taking the whole
3GB of disk space ?
I know
