Re: Proposed zchunk file format - V3

2018-03-22 Thread Michal Domonkos
On Thu, Mar 22, 2018 at 12:39 PM, Jonathan Dieter wrote: > CC'ing fedora-infrastructure, as I think they got lost somewhere along > the way. Oh, thanks. I screwed up (again), this time by hitting "Reply" instead of "Reply to all" in gmail (*facepalm*). > Just to be clear,

Re: Proposed zchunk file format - V3

2018-03-12 Thread Michal Domonkos
On Wed, Feb 28, 2018 at 6:52 PM, Jonathan Dieter wrote: > I've been working on a C implementation of this spec, and came up with > a few other changes. I think it's important to have a checksum of the > index as well as the data as we want to be able to verify that the > index

Re: A proof-of-concept for delta'ing repodata

2018-03-12 Thread Michal Domonkos
Hi Jonathan, To me, the zchunk idea looks good. Incidentally, for the last couple of months, I have been trying to rethink the way we cache metadata on the clients, as part of the libdnf (re)design efforts. My goal was to de-duplicate the data between similar repos in the cache as well as