sry the workload A and B here were mistakely swapped...


发件人:Yifan Zhao <[email protected]<mailto:[email protected]>>
收件人:[email protected] 
<[email protected]<mailto:[email protected]>>
抄 送:Lihongbo(hb-lee,OS Lab) 
<[email protected]<mailto:[email protected]>>; jingrui 
<[email protected]<mailto:[email protected]>>; Mawen (Wayne) 
<[email protected]<mailto:[email protected]>>
主 题:[PATCH 0/3] erofs-utils: mkfs: s3: switch to libcurl multiplexing api
时 间:2025-09-18 23:13:34

From: zhaoyifan <[email protected]>

This patchset use curl_multi* API in s3erofs to improve performance while
interacting with a large number of files.

E2E mkfs.erofs image building time comparison:
- Workload A: Building from 3000 empty files
- Workload B: Building from 3000 files with size in 2~5 Bytes

+------------+------------+------------+
|            | Baseline   | Optimized  |
+------------+------------+------------+
| Workload A | 72.24s     | 5.08s      |
+------------+------------+------------+
| Workload B | 34.31s     | 0.61s      |
+------------+------------+------------+

zhaoyifan (3):
  erofs-utils: add mount/mount.erofs to .gitignore
  erofs-utils: lib: avoid using lseek in diskbuf
  erofs-utils: mkfs: use libcurl multiplexing api to optimize S3
    interaction

 .gitignore       |   1 +
 lib/diskbuf.c    |   7 +-
 lib/remotes/s3.c | 400 +++++++++++++++++++++++++++++++++--------------
 lib/tar.c        |   2 +-
 4 files changed, 284 insertions(+), 126 deletions(-)

--
2.46.0



Reply via email to