Re: Fedora 40 beta freeze now over

2024-04-03 Thread Jonathan Dieter
On Tue, 2024-04-02 at 16:55 -0700, Kevin Fenzi wrote: > On Tue, Apr 02, 2024 at 09:28:31PM +0100, Jonathan Dieter wrote: > >  * Alternatively, we could update whatever's calling createrepo_c > > to add the `f` prefix to all non-rawhide builds. > > I like this option. ;) &

Re: Fedora 40 beta freeze now over

2024-04-02 Thread Jonathan Dieter
On Sat, 2024-03-30 at 09:39 -0700, Kevin Fenzi wrote: > On Fri, Mar 29, 2024 at 11:32:10PM +0000, Jonathan Dieter wrote: > > On Wed, 2024-03-27 at 09:12 -0700, Kevin Fenzi wrote: > > > Our next freeze is for Fedora 40 Final, currently scheduled for > > > 2024-0

Re: Fedora 40 beta freeze now over

2024-03-29 Thread Jonathan Dieter
On Wed, 2024-03-27 at 09:12 -0700, Kevin Fenzi wrote: > Our next freeze is for Fedora 40 Final, currently scheduled for > 2024-04-02, which is NEXT TUESDAY! Could you please update fedora-repo-zdicts to 2403.1 on the server(s) used to generate the metadata? This will reduce the size of the

Re: Adding Passim as a Fedora 40 feature?

2023-09-06 Thread Jonathan Dieter
On Wed, 2023-09-06 at 22:33 +0100, Jonathan Dieter wrote: > On Fri, 2023-08-25 at 12:42 +0100, Richard Hughes wrote: > > The tl;dr: is I want to add a mDNS server that reshares the public > > firmware update metadata from the LVFS on your LAN. The idea is that > > rather than

Re: Adding Passim as a Fedora 40 feature?

2023-09-06 Thread Jonathan Dieter
On Fri, 2023-08-25 at 12:42 +0100, Richard Hughes wrote: > The tl;dr: is I want to add a mDNS server that reshares the public > firmware update metadata from the LVFS on your LAN. The idea is that > rather than 25 users in an office downloading the same ~2MB file from > the CDN every day, the

Re: Orphaning lizardfs

2023-01-29 Thread Jonathan Dieter
anning on a new release sometime this year, but there's still a > few things they're trying to finish up first before releasing v3.13. > Last I heard they wanted it to be out before summer. > JT > > On January 28, 2023 10:14:14 AM Jonathan Dieter > wrote: > > > I've

Orphaning lizardfs

2023-01-28 Thread Jonathan Dieter
I've just orphaned lizardfs. Lizardfs is a clustered network filesystem that has very efficient small file / metadata performance, but hasn't seen any upstream point releases since the end of 2017 and now FTBFS in the latest mass rebuild. Jonathan ___

Re: musings on rust packaging [was Re: F38 proposal: RPM Sequoia (System-Wide Change proposal)]

2022-12-04 Thread Jonathan Dieter
On Thu, 2022-12-01 at 00:41 +, Daniel Alley wrote: > > * zchunk and deltarpm both reimplement / "bundle" multiple different > hashing algorithms zchunk does have bundled versions of various hashing algorithms, but, if it's compiled against OpenSSL (as it is in Fedora), it uses the OpenSSL

Re: Intent to retire: novacom-client, novacom-server

2022-08-17 Thread Jonathan Dieter
On Tue, 2022-08-16 at 22:28 -0500, Maxwell G via devel wrote: > On Tuesday, August 16, 2022 Jonathan Dieter wrote: > > So, unless I hear from someone who wants it within the next week and > > has a plan on how to fix the current FTBFS bug[2], on August 23, I will > > re

Intent to retire: novacom-client, novacom-server

2022-08-16 Thread Jonathan Dieter
In the deep mists of time, I managed to get a HP Touchpad in the Great Fire Sale of 2011[1] and got to experiment with the Glorious System of Operation that was webOS. Next, naturally, was packaging up novacom, the webOS USB management tool (think the WebOS equivalent of adb), for Fedora.

Orphaning deltarpm

2022-03-06 Thread Jonathan Dieter
Hi everyone, I'm orphaning deltarpm because, as it's currently used in Fedora, it's not very effective, bugs keep getting opened against it because it's not working as well as it should (mostly an infra issue as opposed to a problem with the tool itself), and I no longer have the time or

Re: Failed OpenQA tests for zchunk update - how to troubleshoot?

2022-02-21 Thread Jonathan Dieter
On Sun, 2022-02-20 at 15:37 -0800, Adam Williamson wrote: > On Sun, 2022-02-20 at 20:26 +0000, Jonathan Dieter wrote: > > I've just pushed zchunk-1.2.0 to all active Fedora branches, and > > it's > > passed the (admittedly non-comprehensive) zchunk test suite, but > &

Failed OpenQA tests for zchunk update - how to troubleshoot?

2022-02-20 Thread Jonathan Dieter
I've just pushed zchunk-1.2.0 to all active Fedora branches, and it's passed the (admittedly non-comprehensive) zchunk test suite, but I'm seeing 2 OpenQA failed tests in Bodhi: https://bodhi.fedoraproject.org/updates/FEDORA-2022-e4bcaeea7a

Re: SQLAlchemy integration in Flask

2021-12-13 Thread Jonathan Dieter
Sorry for taking so long to reply.  I'm afraid I don't check this mailing list as often as I should. :) On Tue, 2021-12-07 at 08:52 +0100, Aurelien Bompard wrote: > Thanks for your input! > > > 1. We're using a clustered database (CockroachDB, for those who > > care) > > that uses optimistic

Re: SQLAlchemy integration in Flask

2021-12-06 Thread Jonathan Dieter
On Mon, 2021-12-06 at 18:36 +0100, Aurelien Bompard wrote: > Anyway, this long email is about finding a common ground for > SQLAlchemy integration in Flask, while taking into account our > difficult experiences with webframewoks in the past, but not being > locked in them. Is there something that

Re: Freeze break request: Re: Can we update fedora-repo-zdicts on the branched and rawhide composers?

2021-09-09 Thread Jonathan Dieter
On Wed, 2021-09-08 at 09:14 -0700, Kevin Fenzi wrote: > > I've updated it. > > kevin I can confirm that the latest F35 repodata has the dictionaries now. Thanks so much! Jonathan signature.asc Description: This is a digitally signed message part

Can we update fedora-repo-zdicts on the branched and rawhide composers?

2021-08-31 Thread Jonathan Dieter
Since branching, I've put out a new version of fedora-repo-zdicts with dictionaries for F35 and updated dictionaries for Rawhide. This version (2108.1) is now available in all active Fedora/EPEL branches, I think. Can we update fedora-repo-zdicts on the branched and rawhide composers so they get

Re: Please don't update zchunk to 1.1.14 on servers where createrepo_c is run

2021-06-03 Thread Jonathan Dieter
On Wed, 2021-06-02 at 09:35 -0700, Kevin Fenzi wrote: > On Tue, Jun 01, 2021 at 09:13:30PM +0100, Jonathan Dieter wrote: > > A major bug in zchunk-1.1.14 was flagged up to me today.  If zchunk- > > 1.1.14 (on a system with zstd 1.5.0+) is used to create a zck file with > &

Please don't update zchunk to 1.1.14 on servers where createrepo_c is run

2021-06-01 Thread Jonathan Dieter
A major bug in zchunk-1.1.14 was flagged up to me today. If zchunk- 1.1.14 (on a system with zstd 1.5.0+) is used to create a zck file with a zdict, the file will be impossible to decompress. Embarrassingly, the tests weren't testing this combination. The good news is that this doesn't affect

Re: Can we please update fedora-repo-zdicts on the metadata generation servers for F34 zchunk dictionaries?

2021-04-05 Thread Jonathan Dieter
On Sat, 2021-04-03 at 21:46 +0100, Jonathan Dieter wrote: > On Sat, 2021-04-03 at 11:09 -0700, Kevin Fenzi wrote: > > ok. I've installed fedora-repo-zdicts on both branched and rawhide > > composers. > > > > Lets see if that works in tomorrow's compose. > >

Re: Can we please update fedora-repo-zdicts on the metadata generation servers for F34 zchunk dictionaries?

2021-04-03 Thread Jonathan Dieter
On Sat, 2021-04-03 at 11:09 -0700, Kevin Fenzi wrote: > ok. I've installed fedora-repo-zdicts on both branched and rawhide > composers. > > Lets see if that works in tomorrow's compose. Thanks so much! Fingers crossed. :) Jonathan signature.asc Description: This is a digitally signed

Can we please update fedora-repo-zdicts on the metadata generation servers for F34 zchunk dictionaries?

2021-04-02 Thread Jonathan Dieter
Right now, we're not using zdicts for the F34 zchunk metadata because they were only added in fedora-repo-zdicts-2103.1-2 (which should now be in the updates repo in all current Fedora releases). If we could update fedora-repo-zdicts to 2103.1-2 on whichever servers generate the metadata

Re: [ipxe-devel] [ipxe/ipxe] Initial support for automatically choosing resolution based on EDID (#48)

2021-03-21 Thread Jonathan Dieter
Closed #48. -- You are receiving this because you commented. Reply to this email directly or view it on GitHub: https://github.com/ipxe/ipxe/pull/48#event-4487171917___ ipxe-devel mailing list ipxe-devel@lists.ipxe.org

Re: [ipxe-devel] [ipxe/ipxe] Initial support for automatically choosing resolution based on EDID (#48)

2021-03-21 Thread Jonathan Dieter
Sure. Closing now. -- You are receiving this because you commented. Reply to this email directly or view it on GitHub: https://github.com/ipxe/ipxe/pull/48#issuecomment-803655541___ ipxe-devel mailing list ipxe-devel@lists.ipxe.org

Re: Starting raid-check.timer renders system unusable

2021-03-21 Thread Jonathan Dieter
On Sun, 2021-03-21 at 17:52 +, Jonathan Dieter wrote: > I'm really hoping that I'm missing something obvious here, but I fear > that a good chunk of our Fedora systems will be unbootable if they're > rebooted without disabling raid-check.timer. Just to follow up on this, i

Re: Starting raid-check.timer renders system unusable

2021-03-21 Thread Jonathan Dieter
On Sun, 2021-03-21 at 17:52 +, Jonathan Dieter wrote: > There is a workaround: disabling raid-check.timer, but, if you can't > boot due to this bug, you have to boot into single-user mode (which > requires a root password to have been set). As Tom Hughes just pointed out to me,

Starting raid-check.timer renders system unusable

2021-03-21 Thread Jonathan Dieter
Hey everyone, For reference, a bug report has been filed at https://bugzilla.redhat.com/show_bug.cgi?id=1941335 I just wanted to give a heads up that I came across a bug today that renders Fedora 33 systems unbootable, even after a clean install. If systemd starts raid-check.timer, it gets

Re: Delta RPMs in Fedora 34

2021-01-05 Thread Jonathan Dieter
On Tue, 2021-01-05 at 08:49 -0500, Neal Gompa wrote: > To be blunt, I would have never done Zchunk metadata if it was going > to be used as a tool to kill DeltaRPMs. I firmly believe we need both > to have a comprehensive offering that accommodates the needs of > Fedora users across the world.

Re: Fedora 34 Change: DNF/RPM Copy on Write enablement for all variants (System-Wide Change)

2021-01-02 Thread Jonathan Dieter
On Sat, 2021-01-02 at 18:12 +, Jonathan Dieter wrote: > FWIW, I also think it's time for drpms to go.  Aside from any potential > issues with the proposed change, they haven't been useful in Fedora for > three years, (see https://pagure.io/releng/issue/7215), and nobody's > been

Re: Fedora 34 Change: DNF/RPM Copy on Write enablement for all variants (System-Wide Change)

2021-01-02 Thread Jonathan Dieter
On Sat, 2021-01-02 at 13:42 +, Zbigniew Jędrzejewski-Szmek wrote: On Wed, Dec 30, 2020 at 10:10:27AM -0800, Kevin Fenzi wrote: > > This is most likely because we are only making drpms against the most > recent updates. So, we are making very few drpms and only against > things > that recently

Re: Updated zdicts for F33 zchunk metadata

2020-10-08 Thread Jonathan Dieter
Thanks Dusty for the pointers on the Freeze Exception process. I've created https://bugzilla.redhat.com/show_bug.cgi?id=1886581 blocked the Final Freeze Exception bug. Jonathan On Thu, Oct 8, 2020 at 8:32 PM Jonathan Dieter wrote: > > I'm afraid I'm late to the party on updating th

Updated zdicts for F33 zchunk metadata

2020-10-08 Thread Jonathan Dieter
I'm afraid I'm late to the party on updating the zstd dictionaries used by zchunk for F33. I've just built fedora-repo-zdicts-2010.1, which now includes the F33 dictionaries, but we're obviously past final freeze. I would appreciate karma on the following update so it can go in as a zero-day

Re: Failed Delta RPMs observed in repo

2020-02-10 Thread Jonathan Dieter
On Sun, 2020-02-09 at 09:36 -0500, John Mellor wrote: > Question for the repo managers, > > Why do I sometimes see invalid checksums for drpm downloads? E.g: > This excerpt from the update this morning: > > > /var/cache/dnf/updates-7fc4c739b3909d9f/packages/selinux-policy- > >

Re: Why Must I Do "dnf clean all" Before Updating Will Proceed?

2019-06-07 Thread Jonathan Dieter
On Tue, 2019-06-04 at 18:54 -0700, Samuel Sieb wrote: > On 6/1/19 5:27 AM, Garry T. Williams wrote: > > On Friday, May 31, 2019 11:05:20 PM EDT Tim via users wrote: > > > On Fri, 2019-05-31 at 17:18 -0400, Garry Williams wrote: > > > > But, of course, the issue is why this happens in the first

Re: Fedora 31 System-Wide Change proposal: Switch RPMs to zstd compression

2019-05-30 Thread Jonathan Dieter
On Wed, 2019-05-29 at 18:05 -0400, Neal Gompa wrote: > On Wed, May 29, 2019 at 5:53 PM Josh Boyer wrote: > > > > If we did this, wouldn't it make it very difficult to use tools like > > mock on RHEL / CentOS 7 to build for Fedora 3x? Or does RHEL 7 RPM > > support zstd? > > > > We're pretty

Re: Fedora 31 System-Wide Change proposal: Switch RPMs to zstd compression

2019-05-30 Thread Jonathan Dieter
On Wed, 2019-05-29 at 18:32 -0400, James Cassell wrote: > > Would this help with drpms similar to how it helps with faster yum > repo metadata downloads? My biggest problem with drpms is the slow > rebuild speed which is usually slower than my download bandwidth. It > would be a big win if zstd

Re: Fedora 31 System-Wide Change proposal: Switch RPMs to zstd compression

2019-05-30 Thread Jonathan Dieter
On Wed, 2019-05-29 at 20:15 -0600, Chris Murphy wrote: > 'dnf info deltarpm' says > URL : http://gitorious.org/deltarpm/deltarpm > which has an expired certificate, but pushing passed that it says > current version 3.6 is 5 years old. Is this really maintained or > updatabled? Upstream

Re: [PATCH] bodhi-backend: Make sure zchunk dicts are installed

2019-05-23 Thread Jonathan Dieter
On Thu, 2019-05-23 at 17:01 -0400, Randy Barlow wrote: > On Thu, 2019-05-23 at 10:33 -0700, Kevin Fenzi wrote: > > Applied. Thanks. > > One note: The patch to do zchunking is part of Bodhi 4.0.0, which is > not yet in production; we plan to deploy it on Tuesday. Unless I'm mistaken, that patch

Re: [PATCH] bodhi-backend: Make sure zchunk dicts are installed

2019-05-19 Thread Jonathan Dieter
On Sun, 2019-05-19 at 21:25 +0100, Jonathan Dieter wrote: > The zchunk dictionaries used to reduce the size of zchunk metadata seems to > not currently be installed on the bodhi server. This patch makes sure they > are installed. > > Signed-off-by: Jonathan Dieter > --- >

[PATCH] bodhi-backend: Make sure zchunk dicts are installed

2019-05-19 Thread Jonathan Dieter
The zchunk dictionaries used to reduce the size of zchunk metadata seems to not currently be installed on the bodhi server. This patch makes sure they are installed. Signed-off-by: Jonathan Dieter --- roles/bodhi2/backend/tasks/main.yml | 1 + 1 file changed, 1 insertion(+) diff --git a/roles

Re: Can we use SCLs for building for EPEL 6?

2019-04-15 Thread Jonathan Dieter
On Sun, 2019-04-14 at 16:01 -0400, Stephen John Smoogen wrote: > On Sat, 13 Apr 2019 at 21:06, Todd Zullinger wrote: > > Neal Gompa wrote: > > > If devtoolset is available for EPEL6 (which I think it is?) > > > > I don't believe devtoolset was enabled for el6 in koji. > > When it was added to

Re: Can we use SCLs for building for EPEL 6?

2019-04-13 Thread Jonathan Dieter
On Sat, 2019-04-13 at 13:11 -0700, John Reiser wrote: > > Unfortunately, the gcc in EL6 is too old to build zchunk > > In what specific way(s)? Can the complaints from gcc [which version?], > or other tools in the toolchain, be listed here? > Other developers may have faced the same or similar

Can we use SCLs for building for EPEL 6?

2019-04-13 Thread Jonathan Dieter
So, the background is that I'd like to build zchunk for EPEL 6 (it's already built for EPEL 7). Unfortunately, the gcc in EL6 is too old to build zchunk, so I'd prefer to use a newer version from an SCL, rather than rewrite zchunk to be compatible with an ancient version of gcc. I noticed that

Re: [PATCH] bodhi-backend: Add zchunk support to updates and updates-testing repositories

2019-04-12 Thread Jonathan Dieter
On Thu, 2019-04-11 at 18:08 -0700, Kevin Fenzi wrote: > On 4/9/19 11:20 AM, Jonathan Dieter wrote: > > On Tue, 2019-04-09 at 19:14 +0100, Jonathan Dieter wrote: > > > This re-adds zchunk support for the updates and updates-testing > > > repositories > &g

How to fix dnf segmentation fault (zchunk metadata is re-enabled)

2019-04-10 Thread Jonathan Dieter
FESCo has given us the go-ahead to turn zchunk metadata on again[1] for the F30 fedora repository after the librepo segmentation fault bug[2] was fixed. An updated librepo[3] was built a week ago and was pushed to stable five days ago, so most beta users should have the new version. If you're

How to fix dnf segmentation fault (zchunk metadata is re-enabled)

2019-04-10 Thread Jonathan Dieter
FESCo has given us the go-ahead to turn zchunk metadata on again[1] for the F30 fedora repository after the librepo segmentation fault bug[2] was fixed. An updated librepo[3] was built a week ago and was pushed to stable five days ago, so most beta users should have the new version. If you're

Re: [PATCH] bodhi-backend: Add zchunk support to updates and updates-testing repositories

2019-04-09 Thread Jonathan Dieter
On Tue, 2019-04-09 at 19:14 +0100, Jonathan Dieter wrote: > This re-adds zchunk support for the updates and updates-testing repositories > for both rpms and modularity. > > Zchunk metadata was turned off due to a broken version of librepo that made it > out to stable, but a fixed v

[PATCH] bodhi-backend: Add zchunk support to updates and updates-testing repositories

2019-04-09 Thread Jonathan Dieter
on. 1: https://pagure.io/fesco/issue/2116 Signed-off-by: Jonathan Dieter --- roles/bodhi2/backend/templates/pungi.module.conf.j2 | 3 +++ roles/bodhi2/backend/templates/pungi.rpm.conf.j2| 3 +++ 2 files changed, 6 insertions(+) diff --git a/roles/bodhi2/backend/templates/pungi.module.conf.j2

PSA: workaround for segfault when running dnf update in F30

2019-03-31 Thread Jonathan Dieter
librepo-1.9.6 has a major bug that will cause a segfault when a repository has zchunk metadata. To temporarily work around the problem, set zchunk=False in /etc/dnf/dnf.conf or wait until the next updates push comes out About a week ago, we disabled zchunk metadata in the main F30 repository

PSA: workaround for segfault when running dnf update in F30

2019-03-31 Thread Jonathan Dieter
librepo-1.9.6 has a major bug that will cause a segfault when a repository has zchunk metadata. To temporarily work around the problem, set zchunk=False in /etc/dnf/dnf.conf or wait until the next updates push comes out About a week ago, we disabled zchunk metadata in the main F30 repository

Re: [Freeze Break Request] Add zchunk support to updates and updates-testing repositories

2019-03-31 Thread Jonathan Dieter
On Sun, 2019-03-31 at 10:37 -0700, Kevin Fenzi wrote: > On 3/31/19 10:35 AM, Jonathan Dieter wrote: > > On Sun, 2019-03-31 at 10:28 -0700, Kevin Fenzi wrote: > > > On 3/31/19 1:56 AM, Jonathan Dieter wrote: > > > > On Sun, 2019-03-31 at 09:09 +0100, Jonath

Re: [Freeze Break Request] Add zchunk support to updates and updates-testing repositories

2019-03-31 Thread Jonathan Dieter
On Sun, 2019-03-31 at 10:28 -0700, Kevin Fenzi wrote: > On 3/31/19 1:56 AM, Jonathan Dieter wrote: > > On Sun, 2019-03-31 at 09:09 +0100, Jonathan Dieter wrote: > > > Due to an unrelated *major* bug in the latest librepo update ( > > > https://bugzilla.redhat.com/show_bu

Re: [Freeze Break Request] Add zchunk support to updates and updates-testing repositories

2019-03-31 Thread Jonathan Dieter
On Sun, 2019-03-31 at 09:09 +0100, Jonathan Dieter wrote: > Due to an unrelated *major* bug in the latest librepo update ( > https://bugzilla.redhat.com/show_bug.cgi?id=1694411), I'd like to > request that we disable zchunk metadata generation in updates and > updates-testing unti

Re: [Freeze Break Request] Add zchunk support to updates and updates-testing repositories

2019-03-31 Thread Jonathan Dieter
On Sun, 2019-03-31 at 05:13 +, Peter Robinson wrote: > On Sun, Mar 31, 2019 at 6:01 AM Kevin Fenzi wrote: > > On 3/30/19 9:50 PM, Peter Robinson wrote: > > > > Great, thanks! I'll be keeping an eye on the composes to see if there > > > > are any issues. > > > > > > Wasn't this disabled in

Re: [Freeze Break Request] Add zchunk support to updates and updates-testing repositories

2019-03-30 Thread Jonathan Dieter
On Sat, 2019-03-30 at 16:00 -0700, Kevin Fenzi wrote: > On 3/30/19 3:32 PM, Jonathan Dieter wrote: > > On Sat, 2019-03-30 at 15:13 -0700, Kevin Fenzi wrote: > > > On 3/30/19 11:35 AM, Jonathan Dieter wrote: > > > > > > > Stephen and Kevin, thanks so much!

Re: [Freeze Break Request] Add zchunk support to updates and updates-testing repositories

2019-03-30 Thread Jonathan Dieter
On Sat, 2019-03-30 at 15:13 -0700, Kevin Fenzi wrote: > On 3/30/19 11:35 AM, Jonathan Dieter wrote: > > > Stephen and Kevin, thanks so much! > > Can you rebase and attach the patch? > > It's not applying cleanly for me... if not I can try and manually poke > it l

[Freeze Break Request] Add zchunk support to updates and updates-testing repositories

2019-03-30 Thread Jonathan Dieter
Rebased patch against master ___ infrastructure mailing list -- infrastructure@lists.fedoraproject.org To unsubscribe send an email to infrastructure-le...@lists.fedoraproject.org Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html List

[PATCH] Add zchunk support to updates and updates-testing repositories

2019-03-30 Thread Jonathan Dieter
This adds zchunk support for the updates and updates-testing repositories for both rpms and modularity Signed-off-by: Jonathan Dieter --- roles/bodhi2/backend/templates/pungi.module.conf.j2 | 3 +++ roles/bodhi2/backend/templates/pungi.rpm.conf.j2| 3 +++ 2 files changed, 6 insertions

Re: [Freeze Break Request] Add zchunk support to updates and updates-testing repositories

2019-03-30 Thread Jonathan Dieter
On Sat, 2019-03-30 at 14:05 -0400, Stephen John Smoogen wrote: > +1 > > On Sat, 30 Mar 2019 at 13:53, Kevin Fenzi wrote: > > On 3/29/19 1:33 PM, Jonathan Dieter wrote: > > > On Mon, 2019-03-11 at 20:23 +, Jonathan Dieter wrote: > > > > On Mon, 2019-03-

Re: [Freeze Break Request] Add zchunk support to updates and updates-testing repositories

2019-03-29 Thread Jonathan Dieter
On Mon, 2019-03-11 at 20:23 +, Jonathan Dieter wrote: > On Mon, 2019-03-11 at 11:24 -0700, Kevin Fenzi wrote: > > On 3/11/19 12:26 AM, Jonathan Dieter wrote: > > > This adds zchunk support for the updates and updates-testing > > > repositories for both rpms and m

Re: Switching from GCC to llvm-clang for building chromium(vaapi)

2019-03-16 Thread Jonathan Dieter
On Sat, 2019-03-16 at 12:20 -0500, Michael Cronenworth wrote: > On 3/16/19 7:10 AM, Akarshan Biswas wrote: > > With the above stated reasons, I am willing to know your > > suggestions/opinions on this. > > Building with GCC has become quite a headache for me. If it goes against > > the

Re: [Freeze Break Request] Add zchunk support to updates and updates-testing repositories

2019-03-11 Thread Jonathan Dieter
On Mon, 2019-03-11 at 11:24 -0700, Kevin Fenzi wrote: > On 3/11/19 12:26 AM, Jonathan Dieter wrote: > > This adds zchunk support for the updates and updates-testing > > repositories for both rpms and modularity. We already have zchunk > > metadata being generated for the fe

[Freeze Break Request] Add zchunk support to updates and updates-testing repositories

2019-03-11 Thread Jonathan Dieter
-by: Jonathan Dieter --- roles/bodhi2/backend/templates/pungi.module.conf.j2 | 3 +++ roles/bodhi2/backend/templates/pungi.rpm.conf.j2| 3 +++ 2 files changed, 6 insertions(+) diff --git a/roles/bodhi2/backend/templates/pungi.module.conf.j2 b/roles/bodhi2/backend/templates/pungi.module.conf.j2 index

Re: How do we turn zchunk on for updates-testing for F30?

2019-03-10 Thread Jonathan Dieter
On Sun, 2019-03-10 at 15:47 +, Peter Robinson wrote: > git send-email so it's inline on the list for easy review. Thanks for the tip! Just sent it using git send-email. Jonathan ___ infrastructure mailing list --

[PATCH] Add zchunk support to updates and updates-testing repositories

2019-03-10 Thread Jonathan Dieter
This adds zchunk support for the updates and updates-testing repositories for both rpms and modularity Signed-off-by: Jonathan Dieter --- roles/bodhi2/backend/templates/pungi.module.conf.j2 | 3 +++ roles/bodhi2/backend/templates/pungi.rpm.conf.j2| 3 +++ 2 files changed, 6 insertions

Re: How do we turn zchunk on for updates-testing for F30?

2019-03-09 Thread Jonathan Dieter
On Sat, 2019-03-09 at 21:29 +0100, Mikolaj Izdebski wrote: > On Sat, Mar 9, 2019 at 2:29 PM Jonathan Dieter > wrote: > > Hey, I just noticed that, while we have zchunked metadata for the > > F30 > > base repository, it's not enabled to for updates-testing. > > >

Re: How do we turn zchunk on for updates-testing for F30?

2019-03-09 Thread Jonathan Dieter
On Sat, 2019-03-09 at 09:43 -0500, Neal Gompa wrote: > On Sat, Mar 9, 2019 at 8:28 AM Jonathan Dieter > wrote: > > Hey, I just noticed that, while we have zchunked metadata for the > > F30 > > base repository, it's not enabled to for updates-testing. > > >

How do we turn zchunk on for updates-testing for F30?

2019-03-09 Thread Jonathan Dieter
Hey, I just noticed that, while we have zchunked metadata for the F30 base repository, it's not enabled to for updates-testing. I've looked in the ansible repo and in pungi, but I can't see where createrepo_c is actually called for updates-testing. Can someone please point me in the right

Re: Shredding a removable drive (OT)

2019-01-26 Thread Jonathan Dieter
On Fri, 2019-01-25 at 20:24 -0800, Gordon Messmer wrote: > On 1/25/19 6:45 PM, Jonathan Ryshpan wrote: > > Is there a quicker way to protect my data when I give the drives away, > > other than smashing the drives to bits? > > The quickest would be to encrypt the drives from the beginning. When

Re: Call for zchunk repodata testers

2019-01-17 Thread Jonathan Dieter
On Thu, 2019-01-17 at 00:48 +0100, Björn 'besser82' Esser wrote: > Am Mittwoch, den 16.01.2019, 22:08 + schrieb Jonathan Dieter: > > Just a heads up Rawhide has had zchunked metadata for almost three > > weeks, and I'd greatly appreciate some more testing on the client sid

Call for zchunk repodata testers

2019-01-16 Thread Jonathan Dieter
Just a heads up Rawhide has had zchunked metadata for almost three weeks, and I'd greatly appreciate some more testing on the client side before we finish pushing the client changes to Rawhide. If you're running Rawhide, are willing to test, and have backups of libdnf and librepo, please enable

Re: Enabling zchunk metadata generation in F30

2018-12-14 Thread Jonathan Dieter
On Fri, 2018-12-14 at 15:15 -0500, Randy Barlow wrote: > On Fri, 2018-12-14 at 19:02 +0000, Jonathan Dieter wrote: > > Hey Randy, at the moment the --zck option *only* applies to > > primary.xml, filelists.xml and other.xml. It should be pretty > > straightforward to add it

Re: Enabling zchunk metadata generation in F30

2018-12-14 Thread Jonathan Dieter
On Fri, 2018-12-14 at 19:24 +, Jonathan Dieter wrote: > On Fri, 2018-12-14 at 11:13 -0800, Kevin Fenzi wrote: > > On 12/14/18 10:52 AM, Jonathan Dieter wrote: > > > I suspect that the maintainers would like to see this feature tested > > > more before pushing it

Re: Enabling zchunk metadata generation in F30

2018-12-14 Thread Jonathan Dieter
On Fri, 2018-12-14 at 11:13 -0800, Kevin Fenzi wrote: > On 12/14/18 10:52 AM, Jonathan Dieter wrote: > > On Thu, 2018-12-13 at 16:42 -0800, Kevin Fenzi wrote: > > > Cool. > > > > > > I see the new createrepo_c only has a rawhide build... any chance for a

Re: Enabling zchunk metadata generation in F30

2018-12-14 Thread Jonathan Dieter
On Fri, 2018-12-14 at 11:20 -0500, Randy Barlow wrote: > On Thu, 2018-12-13 at 22:56 +0000, Jonathan Dieter wrote: > > The call to createrepo_c or mergerepo_c > > (whichever is run last to generate the final metadata) would need to > > be > > run with the new zchunk argu

Re: Enabling zchunk metadata generation in F30

2018-12-14 Thread Jonathan Dieter
On Thu, 2018-12-13 at 16:42 -0800, Kevin Fenzi wrote: > On 12/13/18 3:34 PM, Jonathan Dieter wrote: > > On Thu, 2018-12-13 at 15:12 -0800, Kevin Fenzi wrote: > > > pungi calls createrepo_c for us (in both rawhide/branched and updates) > > > so we need a pungi patch (pr

Re: Orphaning pykka

2018-12-13 Thread Jonathan Dieter
On Wed, 2018-12-12 at 06:10 +, Raphael Groner wrote: > > I've just orphaned pykka ( > > https://admin.fedoraproject.org/pkgdb/package > > /rpms/pykka/) as I'm no longer using it. > > Hi Jonathan, > what do you use instead? > Regards, Raphael MPD with local music. Jonathan

Re: Enabling zchunk metadata generation in F30

2018-12-13 Thread Jonathan Dieter
On Thu, 2018-12-13 at 15:12 -0800, Kevin Fenzi wrote: > pungi calls createrepo_c for us (in both rawhide/branched and updates) > so we need a pungi patch (probibly with a config option?) to enable > this. If it's added as a optional thing we would need to add that > setting to our pungi-fedora

Enabling zchunk metadata generation in F30

2018-12-13 Thread Jonathan Dieter
Createrepo_c in F30 has finally grown zchunk support and I've packaged up some zdicts that we can use for F30/rawhide, so I'd love to see us start building zchunk metadata for F30. To enable zchunk metadata generation, whichever systems are running createrepo_c/mergerepo_c for Rawhide would need

Best path for Fedora zchunk dictionaries

2018-12-08 Thread Jonathan Dieter
I'm currently in the process of packaging up fedora-repo-zdicts[1], a package which will contain the zchunk dictionaries for all active Fedora releases. When running createrepo_c or mergerepo_c with zchunk support, the directory containing the zdicts is passed in and createrepo_c will choose the

Re: Proposal: Faster composes by eliminating deltarpms and using zchunked rpms instead

2018-12-05 Thread Jonathan Dieter
On Mon, 2018-12-03 at 22:16 +0100, Jan Pokorný wrote: > On 16/11/18 22:07 +0000, Jonathan Dieter wrote: > > The core idea behind zchunk is that a file is split into independently > > compressed chunks and the checksum of each compressed chunk is stored > > in the zchunk head

Re: Proposal: Faster composes by eliminating deltarpms and using zchunked rpms instead

2018-11-22 Thread Jonathan Dieter
On Thu, 2018-11-22 at 11:31 -0500, Josh Boyer wrote: > I'm concerned that this will effectively render EL RPM unable to > handle any Fedora RPMs at all. That's both a practical concern, as > many people develop Fedora using EL and vice versa, and also a broader > ecosystem concern. I would very

Re: Proposal: Faster composes by eliminating deltarpms and using zchunked rpms instead

2018-11-21 Thread Jonathan Dieter
On Wed, 2018-11-21 at 14:36 +0100, Kamil Paral wrote: > On Fri, Nov 16, 2018 at 11:13 PM Jonathan Dieter wrote: > > For reference, this is in reply to Paul's email about lifecycle > > objectives, specifically focusing on problem statement #1[1]. > > > > >

Re: Proposal: Faster composes by eliminating deltarpms and using zchunked rpms instead

2018-11-21 Thread Jonathan Dieter
On Wed, 2018-11-21 at 11:31 -0500, Colin Walters wrote: > After having introduced a new format (OSTree) into the ecosystem here, > as well as working a lot on the Docker/OCI ecosystem, one thing I want > to emphasize is: > > A lot of Red Hat's customers don't connect their systems to the

Re: Proposal: Faster composes by eliminating deltarpms and using zchunked rpms instead

2018-11-20 Thread Jonathan Dieter
On Tue, 2018-11-20 at 12:45 +, Michael Schroeder wrote: > On Mon, Nov 19, 2018 at 08:30:14PM +0000, Jonathan Dieter wrote: > > Just to be clear on this, unlike deltarpm, zchunked rpms shouldn't > > require extra CPU usage on the client side as they don't go through the

Re: Proposal: Faster composes by eliminating deltarpms and using zchunked rpms instead

2018-11-20 Thread Jonathan Dieter
Hey, thanks for the detailed analysis. Comments inline. On Tue, 2018-11-20 at 00:47 +0100, s...@gmx.com wrote: > Based on work I've done in this area, I'm somewhat sceptical that this > will work out well. I spent a decent amount of time comparing various > approaches to data saving for both

Re: Proposal: Faster composes by eliminating deltarpms and using zchunked rpms instead

2018-11-19 Thread Jonathan Dieter
On Mon, 2018-11-19 at 16:29 -0500, Simo Sorce wrote: > On Mon, 2018-11-19 at 21:02 +0000, Jonathan Dieter wrote: > > On Mon, 2018-11-19 at 15:18 -0500, Simo Sorce wrote: > > > I do not think you can just trust random metadata somewhere, one of the > > > points of a rpm

Re: Proposal: Faster composes by eliminating deltarpms and using zchunked rpms instead

2018-11-19 Thread Jonathan Dieter
On Mon, 2018-11-19 at 22:18 +0100, Nicolas Mailhot wrote: > Le lundi 19 novembre 2018 à 20:30 +0000, Jonathan Dieter a écrit : > > The zchunk advantage over deltarpms is much less CPU usage, while its > > disadvantages are slightly larger network usage and increased

Re: Proposal: Faster composes by eliminating deltarpms and using zchunked rpms instead

2018-11-19 Thread Jonathan Dieter
On Mon, 2018-11-19 at 21:14 +, Tom Hughes wrote: > On 19/11/2018 20:30, Jonathan Dieter wrote: > > > On the client: > > The zchunk advantage over regular rpm is decreased network usage, while > > its disadvantage is increased disk usage (since the local chunks

Re: Proposal: Faster composes by eliminating deltarpms and using zchunked rpms instead

2018-11-19 Thread Jonathan Dieter
On Mon, 2018-11-19 at 15:18 -0500, Simo Sorce wrote: > On Mon, 2018-11-19 at 19:58 +0000, Jonathan Dieter wrote: > > That's an interesting thought. I was picturing using the zchunk > > library in the dnf download stage to build a local rpm from the > > verified lo

Re: Proposal: Faster composes by eliminating deltarpms and using zchunked rpms instead

2018-11-19 Thread Jonathan Dieter
On Sun, 2018-11-18 at 13:19 -0500, Stephen John Smoogen wrote: > On Sun, 18 Nov 2018 at 12:49, Neal Gompa wrote: > > On Sun, Nov 18, 2018 at 11:54 AM Jonathan Dieter > > wrote: > > > On Sat, 2018-11-17 at 22:30 +0100, Kevin Kofler wrote: > > > > Jonathan Diete

Re: Proposal: Faster composes by eliminating deltarpms and using zchunked rpms instead

2018-11-19 Thread Jonathan Dieter
On Mon, 2018-11-19 at 20:16 +0100, Jan Pokorný wrote: > On 19/11/18 13:13 +0100, Nicolas Mailhot wrote: > > Le 2018-11-19 12:28, Martin Kolman a écrit : > > > > > Many people might think RAM would not be an issue in 2018, but in > > > practice there are > > > and likely always will be memory

Re: Proposal: Faster composes by eliminating deltarpms and using zchunked rpms instead

2018-11-19 Thread Jonathan Dieter
On Sun, 2018-11-18 at 07:02 +, Leigh Scott wrote: > +1 to anything to rid me of deltarpms, I currently have to disable > this lame default. The irony is that getting deltarpms into Fedora was largely my fault. ;) Sorry, Leigh. Jonathan ___ devel

Re: Proposal: Faster composes by eliminating deltarpms and using zchunked rpms instead

2018-11-19 Thread Jonathan Dieter
On Mon, 2018-11-19 at 14:57 +0100, Miroslav Suchý wrote: > Dne 16. 11. 18 v 23:07 Jonathan Dieter napsal(a): > >1. Downloading a new release of a zchunked rpm would be larger than > > downloading the equivalent deltarpm. This is offset by the fact > > th

Re: Proposal: Faster composes by eliminating deltarpms and using zchunked rpms instead

2018-11-18 Thread Jonathan Dieter
On Sat, 2018-11-17 at 22:30 +0100, Kevin Kofler wrote: > Jonathan Dieter wrote: > > My proposal would be to make zchunk the rpm compression format for > > Fedora. > > Given that: > 1. zchunk is based on zstd, which is typically less efficient in terms of >compressi

Re: Proposal: Faster composes by eliminating deltarpms and using zchunked rpms instead

2018-11-17 Thread Jonathan Dieter
On Sat, 2018-11-17 at 14:43 -0600, Chris Adams wrote: > Once upon a time, Jonathan Dieter said: > > The benefit of zchunked rpms is that, when downloading an updated rpm, > > you would only need to download the chunks that have changed from > > what's on your system. > &

Re: Proposal: Faster composes by eliminating deltarpms and using zchunked rpms instead

2018-11-17 Thread Jonathan Dieter
On Sat, 2018-11-17 at 14:36 -0500, Neal Gompa wrote: > On Sat, Nov 17, 2018 at 1:15 PM Jonathan Dieter wrote: > > Neal, thanks so much for your thoughts on this. Responses inline: > > > > On Sat, 2018-11-17 at 09:53 -0500, Neal Gompa wrote: > > > > >

Re: Proposal: Faster composes by eliminating deltarpms and using zchunked rpms instead

2018-11-17 Thread Jonathan Dieter
Neal, thanks so much for your thoughts on this. Responses inline: On Sat, 2018-11-17 at 09:53 -0500, Neal Gompa wrote: > If we're really considering changing the RPM file format, then we need > a proper discussion on rpm-maint@ and rpm-ecosystem@ mailing lists on > rpm.org. Can you please start

Proposal: Faster composes by eliminating deltarpms and using zchunked rpms instead

2018-11-16 Thread Jonathan Dieter
For reference, this is in reply to Paul's email about lifecycle objectives, specifically focusing on problem statement #1[1]. Have rpm use zchunk as its compression format, removing the need for deltarpms, and thus reducing compose time. This will require changes to both the rpm format and new

Re: Introducing new koji rpmfusion namespace : rpi

2018-11-08 Thread Jonathan Dieter
On Thu, 2018-11-08 at 20:35 +0100, Nicolas Chauvet wrote: > Le jeu. 8 nov. 2018 à 19:43, Jonathan Dieter a > écrit : > > On Thu, 2018-11-08 at 16:57 +, Andrew Bauer wrote: > > > I'll create a new package request for the raspberry-vc libs. I'm > > > not > >

  1   2   3   4   5   6   >