Re: status of forked zlibs in rsync and zsync
On Wed, Sep 30, 2009 at 11:05:58AM +0200, Florian Festi wrote: deltarpm has the same problem as it supports the rsync protocol, too. I think deltarpm's zlib patch to support 'gzip --rsyncable' is different to the rsync patch. I've sent the patch upstream in 2005, but got no response. (The original --rsyncable patch was done by Rusty Russell in 2002, btw) Cheers, Michael. -- Michael Schroeder m...@suse.de SUSE LINUX Products GmbH, GF Markus Rex, HRB 16746 AG Nuernberg main(_){while(_=~getchar())putchar(~_-1/(~(_|32)/13*2-11)*13);} -- fedora-devel-list mailing list fedora-devel-list@redhat.com https://www.redhat.com/mailman/listinfo/fedora-devel-list
Re: status of forked zlibs in rsync and zsync
On Wed, Sep 30, 2009 at 10:27:44AM -0700, Toshio Kuratomi wrote: So... that means the custom zlib isn't necessary to the proper operation of deltarpm, correct? I haven't looked at where in the code this is being used yet but I'm guessing this zlib is used when: 1) Reading the existing rpm -- this should work with vanilla zlib as well 2) Compressing the deltarpm -- this should work with vanilla zlib, just not be as kind to rsync. No, things are a bit different. Fedora's rpm used to have a modified copy of zlib so that the created rpms were more rsync friendly. As deltarpm needs to recreate the same compressed payload I also had to support this. AFAIK the current rpm uses the system's zlib library, so the deltarpm copy is also no longer needed for Fedora. Cheers, Michael. -- Michael Schroeder m...@suse.de SUSE LINUX Products GmbH, GF Markus Rex, HRB 16746 AG Nuernberg main(_){while(_=~getchar())putchar(~_-1/(~(_|32)/13*2-11)*13);} -- fedora-devel-list mailing list fedora-devel-list@redhat.com https://www.redhat.com/mailman/listinfo/fedora-devel-list
Re: Testing libsatsolver on Fedora
On Fri, Jul 31, 2009 at 01:12:10AM -0400, James Antill wrote: On Thu, 2009-07-30 at 21:42 -0400, Bill McGonigle wrote: On 07/30/2009 08:49 AM, Michael Schroeder wrote: Version 0.14.4 should have all fixes. OK, my reported bugs are fixed. It would have been more useful to end the message here, as from what I read Michael just wanted to know how compatible zypp was with Fedora. That's true, my intention was not to start a my package manager is faster than yours flamewar. (Note also that this is not zypp, it's the underlying library used by zypp.) Cheers, Michael. -- Michael Schroeder m...@suse.de SUSE LINUX Products GmbH, GF Markus Rex, HRB 16746 AG Nuernberg main(_){while(_=~getchar())putchar(~_-1/(~(_|32)/13*2-11)*13);} -- fedora-devel-list mailing list fedora-devel-list@redhat.com https://www.redhat.com/mailman/listinfo/fedora-devel-list
Re: Testing libsatsolver on Fedora
On Thu, Jul 30, 2009 at 09:42:08PM -0400, Bill McGonigle wrote: A cursory glance at the output shows similar solutions (the differing reporting formats make it quite the back and forth to analyze). To be fair, I have a few yum plugins loaded, so it may be doing more work. solv's kernel handling appears to behave a bit different than yum's perhaps? I put the output here: http://fpaste.org/paste/20452 That's because the kernels aren't marked for multi-version installation. libsatsolver supports this, but the little solv tool doesn't. Michael. -- Michael Schroeder m...@suse.de SUSE LINUX Products GmbH, GF Markus Rex, HRB 16746 AG Nuernberg main(_){while(_=~getchar())putchar(~_-1/(~(_|32)/13*2-11)*13);} -- fedora-devel-list mailing list fedora-devel-list@redhat.com https://www.redhat.com/mailman/listinfo/fedora-devel-list
Re: Testing libsatsolver on Fedora
On Fri, Jul 31, 2009 at 12:41:15AM +0200, yersinia wrote: Ok. But these tests, or other, are something you could do done this alone already , I am sure. I would not want to repeat myself, but IF YOU WOULD REALLY have a larger user base larger ypu have to publish your work as a independent project. Otherwise I can not find correct, pesonal opion anyway, to ask other distro OSS as Fedora to try your project and also report their result. But YMMV, as eveyone else. What do you mean? libsatsolver is pretty much independent from zypp. Different packages, different git repository. (It's currently hosted in the zypp project, though.) Cheers, Michael. -- Michael Schroeder m...@suse.de SUSE LINUX Products GmbH, GF Markus Rex, HRB 16746 AG Nuernberg main(_){while(_=~getchar())putchar(~_-1/(~(_|32)/13*2-11)*13);} -- fedora-devel-list mailing list fedora-devel-list@redhat.com https://www.redhat.com/mailman/listinfo/fedora-devel-list
Re: Testing libsatsolver on Fedora
On Fri, Jul 31, 2009 at 05:26:31PM +0300, Jussi Lehtola wrote: Please release this as a separate project to help cross-distro development. Libsatsolver is already a separate project. It also has some suport for debian (it can parse the Packages files and knows how debian dependencies work). This would be a pretty nifty tool in Fedora as well. PS. Some kind of a download progress bar (speed % of completion) would Well, it's just a library. Stuff like download progress bar, repository management and the like belong in the layer above libsatsolver. solv is just a very small (2800 lines) and limited application to demo the library functions, it's not meant to be a full blown package management tool. Cheers, Michael. -- Michael Schroeder m...@suse.de SUSE LINUX Products GmbH, GF Markus Rex, HRB 16746 AG Nuernberg main(_){while(_=~getchar())putchar(~_-1/(~(_|32)/13*2-11)*13);} -- fedora-devel-list mailing list fedora-devel-list@redhat.com https://www.redhat.com/mailman/listinfo/fedora-devel-list
Re: Testing libsatsolver on Fedora
On Fri, Jul 31, 2009 at 05:36:14PM +0200, Florian Festi wrote: Not a big surprise as solv does not have coloring (== multilib) support. Actually it has some multilib support, but it's pretty much untested as I don't know exactly how multilib is implemented in Fedora. (SUSE does it very different with their -32bit packages.) Cheers, Michael. -- Michael Schroeder m...@suse.de SUSE LINUX Products GmbH, GF Markus Rex, HRB 16746 AG Nuernberg main(_){while(_=~getchar())putchar(~_-1/(~(_|32)/13*2-11)*13);} -- fedora-devel-list mailing list fedora-devel-list@redhat.com https://www.redhat.com/mailman/listinfo/fedora-devel-list
Re: Testing libsatsolver on Fedora
On Fri, Jul 31, 2009 at 04:23:27PM +0200, Florian Festi wrote: On 07/27/2009 01:01 PM, Michael Schroeder wrote: http://software.opensuse.org/search?baseproject=Fedora:11q=libsatsolver-demo Hmm, where's the source? You can get the source rpm by searching for libsatsolver instead of libsatsolver demo. The git repository is available via: git://git.opensuse.org/projects/zypp/sat-solver.git but we're probably moving over to gitorious.org. Cheers, Michael. -- Michael Schroeder m...@suse.de SUSE LINUX Products GmbH, GF Markus Rex, HRB 16746 AG Nuernberg main(_){while(_=~getchar())putchar(~_-1/(~(_|32)/13*2-11)*13);} -- fedora-devel-list mailing list fedora-devel-list@redhat.com https://www.redhat.com/mailman/listinfo/fedora-devel-list
Re: Testing libsatsolver on Fedora
On Wed, Jul 29, 2009 at 01:57:56PM -0400, Bill McGonigle wrote: On 07/29/2009 06:37 AM, Michael Schroeder wrote: seems like it doesn't have write access to /var/cache/solv. Please chown the directory to your uid. When I do that (or run under sudo) solv segfaults on me. f11, x86_64. http://fpaste.org/paste/20289 By coincidence I stumbled over the same bug yesterday. The repository code could not handle repositories where the filelist contains no absolute files. This was the case for kde-testing-all, as it contains only src rpms. Now fixed. I also fixed the no repomd.xml file bug, it didn't occur to me that the mirrorlist/metalink responses can also contain yum's $releasever/$basearch macros. Solv now supports this. The RPM depends on gpg2 - which I --nodeps'ed away. I have gnupg2 - assuming that's the same? Me bad, gpg2 is the suse name. I now use gnupg2 when building for fedora. Version 0.14.4 should have all fixes. Thanks for testing! Cheers, Michael. -- Michael Schroeder m...@suse.de SUSE LINUX Products GmbH, GF Markus Rex, HRB 16746 AG Nuernberg main(_){while(_=~getchar())putchar(~_-1/(~(_|32)/13*2-11)*13);} -- fedora-devel-list mailing list fedora-devel-list@redhat.com https://www.redhat.com/mailman/listinfo/fedora-devel-list
Re: Testing libsatsolver on Fedora
On Tue, Jul 28, 2009 at 11:00:17PM -0700, Adam Williamson wrote: Of course, that depends on whether what we have in yum is as slow as whatever SUSE had before this. :) I doubt that. It's not an easy task to create software as slow as the 10.x update stack ;-) ISTR that SUSE was rather infamous for very slow package manager performance before zypper came along. To clarify: this has nothing to do with zypper. Both zypper and YaST use libzypp, which was pretty much unusable in the 10.x SUSE releases. That's what prompted me to create the libsatsolver library, now used by libzypp. Thus, both zypper and YaST are fast. (PackageKit also uses libzypp, btw.) Using the same library has the big advantage that you get the same results (and bugs) using all interfaces. Cheers, Michael. -- Michael Schroeder m...@suse.de SUSE LINUX Products GmbH, GF Markus Rex, HRB 16746 AG Nuernberg main(_){while(_=~getchar())putchar(~_-1/(~(_|32)/13*2-11)*13);} -- fedora-devel-list mailing list fedora-devel-list@redhat.com https://www.redhat.com/mailman/listinfo/fedora-devel-list
Re: Testing libsatsolver on Fedora
On Wed, Jul 29, 2009 at 02:44:02PM +0530, Rahul Sundaram wrote: On 07/28/2009 03:04 PM, Michael Schroeder wrote: Ok, solv now supports mirrorlists. Updated packages should be available in an hour or two (depending on the build service load). Tested. Works with mirror lists atleast partially but still too slow. I have compared it with yum some points: - seems like it still accesses some remote hosts because it checks if the metadata is up-to-date. It shouldn't do this the second time you call it, seems like it doesn't have write access to /var/cache/solv. Please chown the directory to your uid. - FL access is slowing it down a bit (FL is the complete filelist). Even worse is that it had to download the file list for the chromium repository every time because of the missing write access. - Also, I've rewritten the file provides algorithm, so it should be quite a bit faster now (packages available in an hour). It now rewrites the cache file after the file provides have been added. $ echo n | ( time ./solv up ) rpm database: cached repo 'fedora': cached repo 'rpmfusion-free': cached repo 'rpmfusion-free-updates': cached repo 'updates': cached Transaction summary: 73 upgraded packages: [...] install size change: -8008 K OK to continue (y/n)? Abort. 0.248u 0.052s 0:00.32 90.6% 0+0k 0+0io 0pf+0w As you can see, if the solv can take full advantage of the cache (no FL loads), it's pretty fast. But this really isn't about execution speed, but correctness of the solver results. Cheers, Michael. -- Michael Schroeder m...@suse.de SUSE LINUX Products GmbH, GF Markus Rex, HRB 16746 AG Nuernberg main(_){while(_=~getchar())putchar(~_-1/(~(_|32)/13*2-11)*13);} -- fedora-devel-list mailing list fedora-devel-list@redhat.com https://www.redhat.com/mailman/listinfo/fedora-devel-list
Re: Testing libsatsolver on Fedora
On Tue, Jul 28, 2009 at 02:15:49AM +0530, Rahul Sundaram wrote: On 07/27/2009 04:31 PM, Michael Schroeder wrote: I'm the author of the libsatsolver library, a library solves package dependencies with a SAT algorithm. This library is currently used in SUSE by YaST/zypp. I'm currently trying to make it less SUSE specific like adding support for package coloring and different repo handling, but I'm pretty sure I didn't catch all things where Fedora is different from SUSE. What's the eventual goal? There's no real goal, I'm just trying to make the library as flexible as possible. So, if you have some spare time, could you give it a try and tell me where it works well/ does stupid things/ doesn't work at all? On Fedora 11 (x86_32) $ sudo solv info coreutils. Keeping reading some of the metadata over and over again instead of caching them it seems. It doesn't cache them if it encountered errors. It also reads the xml files instead of sqlite databases supported more recently. Yes, it doesn't make sense to support those, as libsatsolver doesn't use sqlite. Also claims some of the repos don't have repomd.xml file while they do http://fpaste.org/paste/20055 download error 6 means that curl exited with exit code 6, which means Couldn't resolve host according to the man page. That's pretty strange, because downloading repomd.xml seems to have worked, but primary.xml.gz suddenly fails. rpmfusion-free: is the repo configured to use a mirrorlist instead of metalink? That's not supported yet. Should be easy to add, though. $ sudo solv search quake3 returns nothing after reading some of the repos again for quite sometime. Ping me in irc if you need to test specific commands more. I am mether in freenode and usually in #fedora-devel Probably because it couldn't read the primary.xml file because of the download error 6 problem. Thanks for testing! Cheers, Michael. -- Michael Schroeder m...@suse.de SUSE LINUX Products GmbH, GF Markus Rex, HRB 16746 AG Nuernberg main(_){while(_=~getchar())putchar(~_-1/(~(_|32)/13*2-11)*13);} -- fedora-devel-list mailing list fedora-devel-list@redhat.com https://www.redhat.com/mailman/listinfo/fedora-devel-list
Re: Testing libsatsolver on Fedora
On Tue, Jul 28, 2009 at 11:11:52AM +0200, Adrian Reber wrote: On Tue, Jul 28, 2009 at 10:32:56AM +0200, Michael Schroeder wrote: Also claims some of the repos don't have repomd.xml file while they do http://fpaste.org/paste/20055 download error 6 means that curl exited with exit code 6, which means Couldn't resolve host according to the man page. That's pretty strange, because downloading repomd.xml seems to have worked, but primary.xml.gz suddenly fails. rpmfusion-free: is the repo configured to use a mirrorlist instead of metalink? That's not supported yet. Should be easy to add, though. RPM Fusion only offers mirrorlists. No metalinks. Ok, solv now supports mirrorlists. Updated packages should be available in an hour or two (depending on the build service load). Thanks, Michael. -- Michael Schroeder m...@suse.de SUSE LINUX Products GmbH, GF Markus Rex, HRB 16746 AG Nuernberg main(_){while(_=~getchar())putchar(~_-1/(~(_|32)/13*2-11)*13);} -- fedora-devel-list mailing list fedora-devel-list@redhat.com https://www.redhat.com/mailman/listinfo/fedora-devel-list
Re: Testing libsatsolver on Fedora
On Tue, Jul 28, 2009 at 02:38:06PM +0530, Debarshi Ray wrote: I'm the author of the libsatsolver library, a library solves package dependencies with a SAT algorithm. This library is currently used in SUSE by YaST/zypp. I'm currently trying to make it less SUSE specific like adding support for package coloring and different repo handling, but I'm pretty sure I didn't catch all things where Fedora is different from SUSE. Sometime ago there were some packages submitted for the Zypper stack but the review could not be completed because it did not support 4.6 at that time. Atleast that is what the submitter had commented: https://bugzilla.redhat.com/442714 Yes, but my goal is a bit different. I don't want to push libsatsolver to Fedora (though I wouldn't mind if Fedora uses it ;-), it's about improving results/performance of the library. Thus I'm interested in where yum works better/ is faster. Cheers, Michael. -- Michael Schroeder m...@suse.de SUSE LINUX Products GmbH, GF Markus Rex, HRB 16746 AG Nuernberg main(_){while(_=~getchar())putchar(~_-1/(~(_|32)/13*2-11)*13);} -- fedora-devel-list mailing list fedora-devel-list@redhat.com https://www.redhat.com/mailman/listinfo/fedora-devel-list
Testing libsatsolver on Fedora
Hi folks, I'm the author of the libsatsolver library, a library solves package dependencies with a SAT algorithm. This library is currently used in SUSE by YaST/zypp. I'm currently trying to make it less SUSE specific like adding support for package coloring and different repo handling, but I'm pretty sure I didn't catch all things where Fedora is different from SUSE. To test things I've written a small application called solv that works like a very tiny package manager. It's available via: http://software.opensuse.org/search?baseproject=Fedora:11q=libsatsolver-demo (To get the src rpm search for libsatsolver) The package contains just a single file, /usr/bin/solv. It can be run as normal user, but then the transaction can't be commited. Also, the repository metadata caching mechanism needs write access to /var/cache/solv. If it can't write there, it still works but downloads the metadata again every time it is called. So, if you have some spare time, could you give it a try and tell me where it works well/ does stupid things/ doesn't work at all? Thanks, Michael. -- Michael Schroeder m...@suse.de SUSE LINUX Products GmbH, GF Markus Rex, HRB 16746 AG Nuernberg main(_){while(_=~getchar())putchar(~_-1/(~(_|32)/13*2-11)*13);} -- fedora-devel-list mailing list fedora-devel-list@redhat.com https://www.redhat.com/mailman/listinfo/fedora-devel-list
Re: Testing libsatsolver on Fedora
On Mon, Jul 27, 2009 at 09:04:13AM -0400, Seth Vidal wrote: is libsatsolver supporting file deps as well? Yes, it downloads filelists.xml.gz if a file dep is not matching the standard filter regexps. Btw, there are surprisingly many of such deps in fedora, like: /lib/lsb/init-functions /usr/include/infiniband/verbs.h /usr/lib/libz.so /usr/lib64/util-vserver/sigexec /usr/libexec/poker3d/underware /usr/share/X11/rgb.txt /usr/share/aclocal /usr/share/desktop-menu-patches/redhat-audio-player.desktop /usr/share/emacs/site-lisp /usr/share/fonts/dejavu/DejaVuSans-Bold.ttf /usr/share/java/ecj.jar /var/lib/PolicyKit-public ... Cheers, Michael. -- Michael Schroeder m...@suse.de SUSE LINUX Products GmbH, GF Markus Rex, HRB 16746 AG Nuernberg main(_){while(_=~getchar())putchar(~_-1/(~(_|32)/13*2-11)*13);} -- fedora-devel-list mailing list fedora-devel-list@redhat.com https://www.redhat.com/mailman/listinfo/fedora-devel-list