Re: status of forked zlibs in rsync and zsync

2009-09-30 Thread Michael Schroeder
On Wed, Sep 30, 2009 at 11:05:58AM +0200, Florian Festi wrote:
 deltarpm has the same problem as it supports the rsync protocol, too.

I think deltarpm's zlib patch to support 'gzip --rsyncable' is
different to the rsync patch. I've sent the patch upstream in 2005,
but got no response.

(The original --rsyncable patch was done by Rusty Russell in 2002, btw)

Cheers,
  Michael.

-- 
Michael Schroeder   m...@suse.de
SUSE LINUX Products GmbH, GF Markus Rex, HRB 16746 AG Nuernberg
main(_){while(_=~getchar())putchar(~_-1/(~(_|32)/13*2-11)*13);}

-- 
fedora-devel-list mailing list
fedora-devel-list@redhat.com
https://www.redhat.com/mailman/listinfo/fedora-devel-list


Re: status of forked zlibs in rsync and zsync

2009-09-30 Thread Michael Schroeder
On Wed, Sep 30, 2009 at 10:27:44AM -0700, Toshio Kuratomi wrote:
 So... that means the custom zlib isn't necessary to the proper operation
 of deltarpm, correct?  I haven't looked at where in the code this is
 being used yet but I'm guessing this zlib is used when:
 
 1) Reading the existing rpm -- this should work with vanilla zlib as well
 2) Compressing the deltarpm -- this should work with vanilla zlib, just
 not be as kind to rsync.

No, things are a bit different. Fedora's rpm used to have a
modified copy of zlib so that the created rpms were more rsync
friendly. As deltarpm needs to recreate the same compressed
payload I also had to support this.

AFAIK the current rpm uses the system's zlib library, so the
deltarpm copy is also no longer needed for Fedora.

Cheers,
  Michael.

-- 
Michael Schroeder   m...@suse.de
SUSE LINUX Products GmbH, GF Markus Rex, HRB 16746 AG Nuernberg
main(_){while(_=~getchar())putchar(~_-1/(~(_|32)/13*2-11)*13);}

-- 
fedora-devel-list mailing list
fedora-devel-list@redhat.com
https://www.redhat.com/mailman/listinfo/fedora-devel-list


Re: Testing libsatsolver on Fedora

2009-07-31 Thread Michael Schroeder
On Fri, Jul 31, 2009 at 01:12:10AM -0400, James Antill wrote:
 On Thu, 2009-07-30 at 21:42 -0400, Bill McGonigle wrote:
  On 07/30/2009 08:49 AM, Michael Schroeder wrote:
   Version 0.14.4 should have all fixes.
  
  OK, my reported bugs are fixed.
 
  It would have been more useful to end the message here, as from what I
 read Michael just wanted to know how compatible zypp was with Fedora.

That's true, my intention was not to start a my package manager is
faster than yours flamewar.

(Note also that this is not zypp, it's the underlying library
used by zypp.)

Cheers,
  Michael.

-- 
Michael Schroeder   m...@suse.de
SUSE LINUX Products GmbH, GF Markus Rex, HRB 16746 AG Nuernberg
main(_){while(_=~getchar())putchar(~_-1/(~(_|32)/13*2-11)*13);}

-- 
fedora-devel-list mailing list
fedora-devel-list@redhat.com
https://www.redhat.com/mailman/listinfo/fedora-devel-list


Re: Testing libsatsolver on Fedora

2009-07-31 Thread Michael Schroeder
On Thu, Jul 30, 2009 at 09:42:08PM -0400, Bill McGonigle wrote:
 A cursory glance at the output shows similar solutions (the differing
 reporting formats make it quite the back and forth to analyze).  To be
 fair, I have a few yum plugins loaded, so it may be doing more work.
 
 solv's kernel handling appears to behave a bit different than yum's
 perhaps?  I put the output here:
 
   http://fpaste.org/paste/20452

That's because the kernels aren't marked for multi-version installation.
libsatsolver supports this, but the little solv tool doesn't.

Michael.

-- 
Michael Schroeder   m...@suse.de
SUSE LINUX Products GmbH, GF Markus Rex, HRB 16746 AG Nuernberg
main(_){while(_=~getchar())putchar(~_-1/(~(_|32)/13*2-11)*13);}

-- 
fedora-devel-list mailing list
fedora-devel-list@redhat.com
https://www.redhat.com/mailman/listinfo/fedora-devel-list


Re: Testing libsatsolver on Fedora

2009-07-31 Thread Michael Schroeder
On Fri, Jul 31, 2009 at 12:41:15AM +0200, yersinia wrote:
 Ok. But these tests, or other, are something you  could do done this
 alone already , I am sure. I would not want to repeat myself, but IF
 YOU WOULD REALLY have a larger  user base larger ypu have to  publish
 your work as a independent project. Otherwise I can not find correct,
 pesonal opion anyway, to ask other distro OSS as Fedora to try your
 project and also report their result. But YMMV, as eveyone else.

What do you mean? libsatsolver is pretty much independent from
zypp. Different packages, different git repository. (It's currently
hosted in the zypp project, though.)

Cheers,
  Michael.

-- 
Michael Schroeder   m...@suse.de
SUSE LINUX Products GmbH, GF Markus Rex, HRB 16746 AG Nuernberg
main(_){while(_=~getchar())putchar(~_-1/(~(_|32)/13*2-11)*13);}

-- 
fedora-devel-list mailing list
fedora-devel-list@redhat.com
https://www.redhat.com/mailman/listinfo/fedora-devel-list


Re: Testing libsatsolver on Fedora

2009-07-31 Thread Michael Schroeder
On Fri, Jul 31, 2009 at 05:26:31PM +0300, Jussi Lehtola wrote:
 Please release this as a separate project to help cross-distro
 development.

Libsatsolver is already a separate project. It also has some
suport for debian (it can parse the Packages files and knows
how debian dependencies work).

 This would be a pretty nifty tool in Fedora as well.
 
 PS. Some kind of a download progress bar (speed  % of completion) would

Well, it's just a library. Stuff like download progress bar, repository
management and the like belong in the layer above libsatsolver.

solv is just a very small (2800 lines) and limited application to
demo the library functions, it's not meant to be a full blown package
management tool.

Cheers,
  Michael.

-- 
Michael Schroeder   m...@suse.de
SUSE LINUX Products GmbH, GF Markus Rex, HRB 16746 AG Nuernberg
main(_){while(_=~getchar())putchar(~_-1/(~(_|32)/13*2-11)*13);}

-- 
fedora-devel-list mailing list
fedora-devel-list@redhat.com
https://www.redhat.com/mailman/listinfo/fedora-devel-list


Re: Testing libsatsolver on Fedora

2009-07-31 Thread Michael Schroeder
On Fri, Jul 31, 2009 at 05:36:14PM +0200, Florian Festi wrote:
 Not a big surprise as solv does not have coloring (== multilib) support. 

Actually it has some multilib support, but it's pretty much untested
as I don't know exactly how multilib is implemented in Fedora.
(SUSE does it very different with their -32bit packages.)

Cheers,
  Michael.

-- 
Michael Schroeder   m...@suse.de
SUSE LINUX Products GmbH, GF Markus Rex, HRB 16746 AG Nuernberg
main(_){while(_=~getchar())putchar(~_-1/(~(_|32)/13*2-11)*13);}

-- 
fedora-devel-list mailing list
fedora-devel-list@redhat.com
https://www.redhat.com/mailman/listinfo/fedora-devel-list


Re: Testing libsatsolver on Fedora

2009-07-31 Thread Michael Schroeder
On Fri, Jul 31, 2009 at 04:23:27PM +0200, Florian Festi wrote:
 On 07/27/2009 01:01 PM, Michael Schroeder wrote:
 http://software.opensuse.org/search?baseproject=Fedora:11q=libsatsolver-demo
 
 Hmm, where's the source?

You can get the source rpm by searching for libsatsolver instead
of libsatsolver demo. The git repository is available via:

git://git.opensuse.org/projects/zypp/sat-solver.git

but we're probably moving over to gitorious.org.

Cheers,
  Michael.

-- 
Michael Schroeder   m...@suse.de
SUSE LINUX Products GmbH, GF Markus Rex, HRB 16746 AG Nuernberg
main(_){while(_=~getchar())putchar(~_-1/(~(_|32)/13*2-11)*13);}

-- 
fedora-devel-list mailing list
fedora-devel-list@redhat.com
https://www.redhat.com/mailman/listinfo/fedora-devel-list


Re: Testing libsatsolver on Fedora

2009-07-30 Thread Michael Schroeder
On Wed, Jul 29, 2009 at 01:57:56PM -0400, Bill McGonigle wrote:
 On 07/29/2009 06:37 AM, Michael Schroeder wrote:
  seems like it doesn't
have write access to /var/cache/solv. Please chown the directory
to your uid.
 
 When I do that (or run under sudo) solv segfaults on me.  f11, x86_64.
 
   http://fpaste.org/paste/20289

By coincidence I stumbled over the same bug yesterday. The
repository code could not handle repositories where the filelist
contains no absolute files. This was the case for kde-testing-all,
as it contains only src rpms. Now fixed.

I also fixed the no repomd.xml file bug, it didn't occur to
me that the mirrorlist/metalink responses can also contain yum's
$releasever/$basearch macros. Solv now supports this.

 The RPM depends on gpg2 - which I --nodeps'ed away.  I have gnupg2 -
 assuming that's the same?

Me bad, gpg2 is the suse name. I now use gnupg2 when building
for fedora. Version 0.14.4 should have all fixes.

Thanks for testing!

Cheers,
  Michael.

-- 
Michael Schroeder   m...@suse.de
SUSE LINUX Products GmbH, GF Markus Rex, HRB 16746 AG Nuernberg
main(_){while(_=~getchar())putchar(~_-1/(~(_|32)/13*2-11)*13);}

-- 
fedora-devel-list mailing list
fedora-devel-list@redhat.com
https://www.redhat.com/mailman/listinfo/fedora-devel-list


Re: Testing libsatsolver on Fedora

2009-07-29 Thread Michael Schroeder
On Tue, Jul 28, 2009 at 11:00:17PM -0700, Adam Williamson wrote:
 Of course, that depends on whether what we have in yum is as slow as
 whatever SUSE had before this. :)

I doubt that. It's not an easy task to create software as slow
as the 10.x update stack ;-)

 ISTR that SUSE was rather infamous for
 very slow package manager performance before zypper came along.

To clarify: this has nothing to do with zypper. Both zypper and
YaST use libzypp, which was pretty much unusable in the 10.x
SUSE releases. That's what prompted me to create the libsatsolver
library, now used by libzypp. Thus, both zypper and YaST are fast.
(PackageKit also uses libzypp, btw.)
Using the same library has the big advantage that you get the same
results (and bugs) using all interfaces.

Cheers,
  Michael.

-- 
Michael Schroeder   m...@suse.de
SUSE LINUX Products GmbH, GF Markus Rex, HRB 16746 AG Nuernberg
main(_){while(_=~getchar())putchar(~_-1/(~(_|32)/13*2-11)*13);}

-- 
fedora-devel-list mailing list
fedora-devel-list@redhat.com
https://www.redhat.com/mailman/listinfo/fedora-devel-list


Re: Testing libsatsolver on Fedora

2009-07-29 Thread Michael Schroeder
On Wed, Jul 29, 2009 at 02:44:02PM +0530, Rahul Sundaram wrote:
 On 07/28/2009 03:04 PM, Michael Schroeder wrote:
 
  
  Ok, solv now supports mirrorlists. Updated packages should be
  available in an hour or two (depending on the build service load).
 
 Tested. Works with mirror lists atleast partially but still too slow. I
 have compared it with yum

some points:

- seems like it still accesses some remote hosts
  because it checks if the metadata is up-to-date. It shouldn't
  do this the second time you call it, seems like it doesn't
  have write access to /var/cache/solv. Please chown the directory
  to your uid.

- FL access is slowing it down a bit (FL is the complete filelist).
  Even worse is that it had to download the file list for the
  chromium repository every time because of the missing write
  access.

- Also, I've rewritten the file provides algorithm, so it should
  be quite a bit faster now (packages available in an hour). It
  now rewrites the cache file after the file provides have been
  added.

$ echo n | ( time ./solv up )
rpm database: cached
repo 'fedora': cached
repo 'rpmfusion-free': cached
repo 'rpmfusion-free-updates': cached
repo 'updates': cached

Transaction summary:

73 upgraded packages:
[...]
install size change: -8008 K

OK to continue (y/n)? Abort.
0.248u 0.052s 0:00.32 90.6% 0+0k 0+0io 0pf+0w

  As you can see, if the solv can take full advantage of the
  cache (no FL loads), it's pretty fast.

But this really isn't about execution speed, but correctness
of the solver results.

Cheers,
  Michael.

-- 
Michael Schroeder   m...@suse.de
SUSE LINUX Products GmbH, GF Markus Rex, HRB 16746 AG Nuernberg
main(_){while(_=~getchar())putchar(~_-1/(~(_|32)/13*2-11)*13);}

-- 
fedora-devel-list mailing list
fedora-devel-list@redhat.com
https://www.redhat.com/mailman/listinfo/fedora-devel-list


Re: Testing libsatsolver on Fedora

2009-07-28 Thread Michael Schroeder
On Tue, Jul 28, 2009 at 02:15:49AM +0530, Rahul Sundaram wrote:
 On 07/27/2009 04:31 PM, Michael Schroeder wrote:
  I'm the author of the libsatsolver library, a library solves
  package dependencies with a SAT algorithm.
  This library is currently used in SUSE by YaST/zypp. I'm currently
  trying to make it less SUSE specific like adding support for package
  coloring and different repo handling, but I'm pretty sure I didn't
  catch all things where Fedora is different from SUSE.
 
 What's the eventual goal?

There's no real goal, I'm just trying to make the library as
flexible as possible.

  So, if you have some spare time, could you give it a try and tell
  me where it works well/ does stupid things/ doesn't work at all?
 
 On Fedora 11 (x86_32)
 
 $ sudo solv info coreutils. Keeping reading some of the metadata over
 and over again instead of caching them it seems.

It doesn't cache them if it encountered errors.

 It also reads the xml
 files instead of sqlite databases supported more recently.

Yes, it doesn't make sense to support those, as libsatsolver doesn't
use sqlite.

 Also claims
 some of the repos don't have repomd.xml file while they do

 http://fpaste.org/paste/20055

download error 6 means that curl exited with exit code 6, which
means Couldn't resolve host according to the man page. That's
pretty strange, because downloading repomd.xml seems to have worked,
but primary.xml.gz suddenly fails.

rpmfusion-free: is the repo configured to use a mirrorlist instead
of metalink? That's not supported yet. Should be easy to add, though.

 $ sudo solv search quake3
 
 returns nothing after reading some of the repos again for quite
 sometime. Ping me in irc if you need to test specific commands more. I
 am mether in freenode and usually in #fedora-devel

Probably because it couldn't read the primary.xml file because of
the download error 6 problem.

Thanks for testing!

Cheers,
  Michael.

-- 
Michael Schroeder   m...@suse.de
SUSE LINUX Products GmbH, GF Markus Rex, HRB 16746 AG Nuernberg
main(_){while(_=~getchar())putchar(~_-1/(~(_|32)/13*2-11)*13);}

-- 
fedora-devel-list mailing list
fedora-devel-list@redhat.com
https://www.redhat.com/mailman/listinfo/fedora-devel-list


Re: Testing libsatsolver on Fedora

2009-07-28 Thread Michael Schroeder
On Tue, Jul 28, 2009 at 11:11:52AM +0200, Adrian Reber wrote:
 On Tue, Jul 28, 2009 at 10:32:56AM +0200, Michael Schroeder wrote:
   Also claims
   some of the repos don't have repomd.xml file while they do
  
   http://fpaste.org/paste/20055
  
  download error 6 means that curl exited with exit code 6, which
  means Couldn't resolve host according to the man page. That's
  pretty strange, because downloading repomd.xml seems to have worked,
  but primary.xml.gz suddenly fails.
  
  rpmfusion-free: is the repo configured to use a mirrorlist instead
  of metalink? That's not supported yet. Should be easy to add, though.
 
 RPM Fusion only offers mirrorlists. No metalinks.

Ok, solv now supports mirrorlists. Updated packages should be
available in an hour or two (depending on the build service load).

Thanks,
  Michael.

-- 
Michael Schroeder   m...@suse.de
SUSE LINUX Products GmbH, GF Markus Rex, HRB 16746 AG Nuernberg
main(_){while(_=~getchar())putchar(~_-1/(~(_|32)/13*2-11)*13);}

-- 
fedora-devel-list mailing list
fedora-devel-list@redhat.com
https://www.redhat.com/mailman/listinfo/fedora-devel-list


Re: Testing libsatsolver on Fedora

2009-07-28 Thread Michael Schroeder
On Tue, Jul 28, 2009 at 02:38:06PM +0530, Debarshi Ray wrote:
  I'm the author of the libsatsolver library, a library solves
  package dependencies with a SAT algorithm.
  This library is currently used in SUSE by YaST/zypp. I'm currently
  trying to make it less SUSE specific like adding support for package
  coloring and different repo handling, but I'm pretty sure I didn't
  catch all things where Fedora is different from SUSE.
 
 Sometime ago there were some packages submitted for the Zypper stack
 but the review could not be completed because it did not support 4.6
 at that time. Atleast that is what the submitter had commented:
 https://bugzilla.redhat.com/442714

Yes, but my goal is a bit different. I don't want to push libsatsolver
to Fedora (though I wouldn't mind if Fedora uses it ;-), it's about
improving results/performance of the library. Thus I'm interested in
where yum works better/ is faster.

Cheers,
  Michael.

-- 
Michael Schroeder   m...@suse.de
SUSE LINUX Products GmbH, GF Markus Rex, HRB 16746 AG Nuernberg
main(_){while(_=~getchar())putchar(~_-1/(~(_|32)/13*2-11)*13);}

-- 
fedora-devel-list mailing list
fedora-devel-list@redhat.com
https://www.redhat.com/mailman/listinfo/fedora-devel-list


Testing libsatsolver on Fedora

2009-07-27 Thread Michael Schroeder

Hi folks,

I'm the author of the libsatsolver library, a library solves
package dependencies with a SAT algorithm.
This library is currently used in SUSE by YaST/zypp. I'm currently
trying to make it less SUSE specific like adding support for package
coloring and different repo handling, but I'm pretty sure I didn't
catch all things where Fedora is different from SUSE.

To test things I've written a small application called solv that
works like a very tiny package manager. It's available via:

http://software.opensuse.org/search?baseproject=Fedora:11q=libsatsolver-demo

(To get the src rpm search for libsatsolver)

The package contains just a single file, /usr/bin/solv. It can
be run as normal user, but then the transaction can't be commited.
Also, the repository metadata caching mechanism needs write access
to /var/cache/solv. If it can't write there, it still works but
downloads the metadata again every time it is called.

So, if you have some spare time, could you give it a try and tell
me where it works well/ does stupid things/ doesn't work at all?

Thanks,
  Michael.

-- 
Michael Schroeder   m...@suse.de
SUSE LINUX Products GmbH, GF Markus Rex, HRB 16746 AG Nuernberg
main(_){while(_=~getchar())putchar(~_-1/(~(_|32)/13*2-11)*13);}

-- 
fedora-devel-list mailing list
fedora-devel-list@redhat.com
https://www.redhat.com/mailman/listinfo/fedora-devel-list


Re: Testing libsatsolver on Fedora

2009-07-27 Thread Michael Schroeder
On Mon, Jul 27, 2009 at 09:04:13AM -0400, Seth Vidal wrote:
 is libsatsolver supporting file deps as well?

Yes, it downloads filelists.xml.gz if a file dep is not matching the
standard filter regexps.

Btw, there are surprisingly many of such deps in fedora, like:

  /lib/lsb/init-functions
  /usr/include/infiniband/verbs.h
  /usr/lib/libz.so
  /usr/lib64/util-vserver/sigexec
  /usr/libexec/poker3d/underware
  /usr/share/X11/rgb.txt
  /usr/share/aclocal
  /usr/share/desktop-menu-patches/redhat-audio-player.desktop
  /usr/share/emacs/site-lisp
  /usr/share/fonts/dejavu/DejaVuSans-Bold.ttf
  /usr/share/java/ecj.jar
  /var/lib/PolicyKit-public
  ...

Cheers,
  Michael.

-- 
Michael Schroeder   m...@suse.de
SUSE LINUX Products GmbH, GF Markus Rex, HRB 16746 AG Nuernberg
main(_){while(_=~getchar())putchar(~_-1/(~(_|32)/13*2-11)*13);}

-- 
fedora-devel-list mailing list
fedora-devel-list@redhat.com
https://www.redhat.com/mailman/listinfo/fedora-devel-list