Re: [lustre-discuss] Lustre optimize for spares data files ?

2020-09-09 Thread Andreas Dilger
On Sep 8, 2020, at 9:13 PM, Tung-Han Hsieh wrote: > > I would like to ask whether Lustre file system has implemented the > function to optimize for large sparse data files ? > > For example, a 3GB data file but with more than 80% bytes zero, can > Lustre file system optimize the storage not

Re: [lustre-discuss] Lustre optimize for spares data files ?

2020-09-09 Thread Robert Redl
Dear Tung-Han, Am 09.09.20 um 09:49 schrieb Tung-Han Hsieh: > Dear Robert, > > Thank you very much for your prompt reply. > > I have additional questions. Since we have a large Lustre file > system pool, some are OST with ldiskfs backend, and some are OST > with ZFS backend. Can I just enable

[lustre-discuss] client syslog flood with "client_bulk_callback()) event type 2, status -103"

2020-09-09 Thread 肖正刚
Hi, all After upgrade lustre client from 2.12.2 to 2.12.5,we found some clients flood with messages like " [Wed Sep 9 15:49:05 2020] LustreError: 3476:0:(events.c:200:client_bulk_callback()) event type 2, status -103, desc 9a1f3cafd000 [Wed Sep 9 15:49:06 2020] LustreError:

Re: [lustre-discuss] Lustre optimize for spares data files ?

2020-09-09 Thread Tung-Han Hsieh
Dear Robert, Thank you very much for your prompt reply. I have additional questions. Since we have a large Lustre file system pool, some are OST with ldiskfs backend, and some are OST with ZFS backend. Can I just enable compression on the ZFS backend which is going to be joined into the Lustre

Re: [lustre-discuss] Lustre optimize for spares data files ?

2020-09-09 Thread Robert Redl
Dear Tung-Han, you can use Lustre with ZFS backend and enabled compression. That has the effect you are looking for and works very well. Cheers, Robert Am 09.09.20 um 05:13 schrieb Tung-Han Hsieh: > Dear All, > > I would like to ask whether Lustre file system has implemented the > function to