Re: The future of SIS

2023-10-17 Thread Jean-Daniel Dupas
Le 17 oct. 2023 à 16:34, Marc a écrit : The problem is a bit what everyone understands as s3. I associate this indeed also with an http endpoint on object storage. But the ceph plugin skips this http and talks directly to object store. I don't think you

Re: The future of SIS

2023-10-17 Thread Laura Smith via dovecot
--- Original Message --- On Tuesday, October 17th, 2023 at 15:27, Filip Hanes via dovecot wrote: > Other S3 implementation is Minio on top of any posix filesystem - you can > choose which fills your needs. Minio is great in general, the only thing I would say it its a little bit

RE: The future of SIS

2023-10-17 Thread Marc
> > > > The problem is a bit what everyone understands as s3. I associate > this indeed also with an http endpoint on object storage. But the ceph > plugin skips this http and talks directly to object store. I don't think > you would like to operate on this http level. If I look at this

Re: The future of SIS

2023-10-17 Thread Jean-Daniel Dupas
Le 17 oct. 2023 à 13:12, Marc a écrit : Is s3 not to slow for this? I think the clue is in the name "s3- compatible". Clearly calling out to "real" (AWS) S3 would be a non-starter.

RE: The future of SIS

2023-10-17 Thread Marc
> > 17.10.2023 12:22, Filip Hanes via dovecot пишет: > > S3-compatible storage is very good for multi-server installations where > you need redundancy, availability. S3 is basically HTTP server so you can > code your own logic on stored emails, balancers, caches, deduplication, > compression,

Re: The future of SIS

2023-10-17 Thread Dmitry Melekhov
17.10.2023 12:22, Filip Hanes via dovecot пишет: S3-compatible storage is very good for multi-server installations where you need redundancy, availability. S3 is basically HTTP server so you can code your own logic on stored emails, balancers, caches, deduplication,

RE: The future of SIS

2023-10-17 Thread Marc
> > > > > > If you are using Ubuntu, OpenZFS is readily available, and support > deduplication natively. > > > I thought nobody sane actually used ZFS dedup because it eats RAM for > breakfast, lunch and dinner ? > What an interesting and informing reading lately!! Thanks everyone!!

RE: The future of SIS

2023-10-17 Thread Marc
> >>> > Is s3 not to slow for this? > > >>> I think the clue is in the name "s3-compatible". > >>> > >>> Clearly calling out to "real" (AWS) S3 would be a non-starter. > >>> > >>> But a local installation of something like CEPH, MinIO or whatever on > the > >>> same LAN ? I'd think that

Re: The future of SIS

2023-10-17 Thread Laura Smith via dovecot
--- Original Message --- On Tuesday, October 17th, 2023 at 06:46, Jean-Daniel Dupas wrote: > > If you are using Ubuntu, OpenZFS is readily available, and support > deduplication natively. I thought nobody sane actually used ZFS dedup because it eats RAM for breakfast, lunch and

Re: The future of SIS

2023-10-17 Thread Filip Hanes via dovecot
> Day 16. 10. 2023 21:30, Emmanuel Fusté wrote: > > Le 16/10/2023 à 19:44, Marc a écrit : >>> Is s3 not to slow for this? >>> I think the clue is in the name "s3-compatible". >>> >>> Clearly calling out to "real" (AWS) S3 would be a non-starter. >>> >>> But a local installation of

Re: The future of SIS

2023-10-17 Thread Filip Hanes via dovecot
> Day 17. 10. 2023 7:46, Jean-Daniel Dupas wrote: > > If you are using Ubuntu, OpenZFS is readily available, and support > deduplication natively. > Else it is also available on other platforms, but may require more setup. Filesystems does not have deduplication effective for emails. They