Re: mergerepo fails with PCDATA invalid Char value 8
On Sun, Mar 15, 2009 at 6:39 PM, Mike Bonnet mi...@redhat.com wrote: Steve Traylen wrote: On Sun, Mar 15, 2009 at 12:45 PM, Steve Traylen st...@traylen.net wrote: Hi, Got koji basically working for me over the last couple of weeks. Was very keen to try its new external repository support. Starting with a fresh instance I made a tag (dist-slc5) containing two repos. koji add-external-repo -t dist-slc5 -p 10 slc5-64-base http://linuxsoft.cern.ch/cern/slc5X/x86_64/yum/os koji add-external-repo -t dist-slc5 -p 10 slc5-32-base http://linuxsoft.cern.ch/cern/slc5X/i386/yum/os and then tried to make a koji repo from that. koji regen-repo dist-slc5 This called /usr/libexec/kojid/mergerepos -a i386 -b /mnt/koji/repos/dist-slc5-build/189/i386/blocklist -o /tmp/koji/tasks/556/556/repo \ -g /mnt/koji/repos/dist-slc5-build/189/groups/comps.xml -r http://linuxsoft.cern.ch/cern/slc5X/x86_64/yum/os/ \ -r http://linuxsoft.cern.ch/cern/slc5X/i386/yum/os/ resulting in as below. Any ideas ? To hopefully answer my own question. Is this because these slc yum repositories do not contain the sqlite files thats that mergerepo makes use of. Looking at CentOS and ScientificLinux neither of these look to make use of the '-d' option to createrepo to generate the sqlite files. Is there a way around this or we have to ask CentOS to generate the sql files? The error occurs when parsing other.xml. I would check your external repos to see if other.xml passes XML validation successfully. Hi Mike, That's exactly the problem. Thanks. It fails later now but I'll look into it first. Steve Of course maybe it is something else entirely? Steve Steve process:19630): GLib-WARNING **: GError set over the top of a previous GError or uninitialized memory. This indicates a bug in someone's code. You must ensure an error is NULL before it's set. The overwriting error message was: Parsing other.xml error: PCDATA invalid Char value 8 Traceback (most recent call last): File /usr/libexec/kojid/mergerepos, line 241, in module main(sys.argv[1:]) File /usr/libexec/kojid/mergerepos, line 236, in main merge.write_metadata() File /usr/libexec/kojid/mergerepos, line 216, in write_metadata mdgen.doPkgMetadata() File /usr/lib/python2.5/site-packages/createrepo/__init__.py, line 332, in doPkgMetadata self.writeMetadataDocs(packages) File /usr/lib/python2.5/site-packages/createrepo/__init__.py, line 475, in writeMetadataDocs clog_limit=self.conf.changelog_limit)) File /usr/lib/python2.5/site-packages/yum/packages.py, line 959, in xml_dump_other_metadata msg += %s\n/package\n % misc.to_unicode(self._dump_changelog(clog_limit)) File /usr/lib/python2.5/site-packages/yum/packages.py, line 927, in _dump_changelog if not self.changelog: File /usr/lib/python2.5/site-packages/yum/packages.py, line 423, in lambda changelog = property(fget=lambda self: self.returnChangelog()) File /usr/lib/python2.5/site-packages/yum/sqlitesack.py, line 225, in returnChangelog self._loadChangelog() File /usr/lib/python2.5/site-packages/yum/sqlitesack.py, line 202, in _loadChangelog self.sack.populate(self.repo, mdtype='otherdata') File /usr/lib/python2.5/site-packages/yum/yumRepo.py, line 184, in populate dobj = repo_cache_function(xml, csum) File /usr/lib/python2.5/site-packages/sqlitecachec.py, line 60, in getOtherdata self.repoid)) TypeError: Parsing other.xml error: PCDATA invalid Char value 8 Steve -- Steve Traylen -- Fedora-buildsys-list mailing list Fedora-buildsys-list@redhat.com https://www.redhat.com/mailman/listinfo/fedora-buildsys-list -- Steve Traylen -- Fedora-buildsys-list mailing list Fedora-buildsys-list@redhat.com https://www.redhat.com/mailman/listinfo/fedora-buildsys-list
unicode error with mergerepos against CentOS 5.
Hi,
$ rpm -qf /usr/libexec/kojid/mergerepos
koji-builder-1.3.1-1.fc10.noarch
Running agaist Fedora repositories all looks well but against CentOS.
/usr/libexec/kojid/mergerepos -a x86_64 \
-o repo \
-r http://swissmirror.silyus.net/centos/5.2/os/i386/
Adding repo: http://swissmirror.silyus.net/centos/5.2/os/i386/
1/400 - Deployment_Guide-or-IN-5.2-9.el5.centos.noarch
2/400 - 1:kde-i18n-Icelandic-3.5.4-1.noarch
328/400 - system-config-users-1.2.51-4.el5.noarch
329/400 - yum-priorities-1.1.10-9.el5.centos.noarch
Traceback (most recent call last):
File /usr/libexec/kojid/mergerepos, line 241, in module
main(sys.argv[1:])
File /usr/libexec/kojid/mergerepos, line 236, in main
merge.write_metadata()
File /usr/libexec/kojid/mergerepos, line 216, in write_metadata
mdgen.doPkgMetadata()
File /usr/lib/python2.5/site-packages/createrepo/__init__.py, line
332, in doPkgMetadata
self.writeMetadataDocs(packages)
File /usr/lib/python2.5/site-packages/createrepo/__init__.py, line
472, in writeMetadataDocs
self.primaryfile.write(po.xml_dump_primary_metadata())
File /usr/lib/python2.5/site-packages/yum/packages.py, line 943,
in xml_dump_primary_metadata
msg += misc.to_unicode(self._dump_format_items())
File /usr/lib/python2.5/site-packages/yum/packages.py, line 809,
in _dump_format_items
msg += self._dump_pco('provides')
UnicodeDecodeError: 'ascii' codec can't decode byte 0xc2 in position
38: ordinal not in range(128)
Tried with a few other repos as well, e.g the i386 one , the two
merged , ... it fails the same
though apparently at different packages.
--
Steve Traylen
--
Fedora-buildsys-list mailing list
Fedora-buildsys-list@redhat.com
https://www.redhat.com/mailman/listinfo/fedora-buildsys-list
Re: unicode error with mergerepos against CentOS 5.
On Mon, 16 Mar 2009, Steve Traylen wrote:
Hi,
$ rpm -qf /usr/libexec/kojid/mergerepos
koji-builder-1.3.1-1.fc10.noarch
Running agaist Fedora repositories all looks well but against CentOS.
/usr/libexec/kojid/mergerepos -a x86_64 \
-o repo \
-r http://swissmirror.silyus.net/centos/5.2/os/i386/
Adding repo: http://swissmirror.silyus.net/centos/5.2/os/i386/
1/400 - Deployment_Guide-or-IN-5.2-9.el5.centos.noarch
2/400 - 1:kde-i18n-Icelandic-3.5.4-1.noarch
328/400 - system-config-users-1.2.51-4.el5.noarch
329/400 - yum-priorities-1.1.10-9.el5.centos.noarch
Traceback (most recent call last):
File /usr/libexec/kojid/mergerepos, line 241, in module
main(sys.argv[1:])
File /usr/libexec/kojid/mergerepos, line 236, in main
merge.write_metadata()
File /usr/libexec/kojid/mergerepos, line 216, in write_metadata
mdgen.doPkgMetadata()
File /usr/lib/python2.5/site-packages/createrepo/__init__.py, line
332, in doPkgMetadata
self.writeMetadataDocs(packages)
File /usr/lib/python2.5/site-packages/createrepo/__init__.py, line
472, in writeMetadataDocs
self.primaryfile.write(po.xml_dump_primary_metadata())
File /usr/lib/python2.5/site-packages/yum/packages.py, line 943,
in xml_dump_primary_metadata
msg += misc.to_unicode(self._dump_format_items())
File /usr/lib/python2.5/site-packages/yum/packages.py, line 809,
in _dump_format_items
msg += self._dump_pco('provides')
UnicodeDecodeError: 'ascii' codec can't decode byte 0xc2 in position
38: ordinal not in range(128)
Tried with a few other repos as well, e.g the i386 one , the two
merged , ... it fails the same
though apparently at different packages.
the metadata you're pulling in was written with a much older createrepo
which was less picky about some of the data it wrote back out. So you end
up with some pkgs with dodgy data in the changelogs.
-sv
--
Fedora-buildsys-list mailing list
Fedora-buildsys-list@redhat.com
https://www.redhat.com/mailman/listinfo/fedora-buildsys-list
Re: how to build srpms on koji?
I am trying to running the local koji instance. Do I have to make some extra configurations beside what the wiki have mentioned? -- Fedora-buildsys-list mailing list Fedora-buildsys-list@redhat.com https://www.redhat.com/mailman/listinfo/fedora-buildsys-list
Re: buildSRPMfromSCM issue
Jitesh Shah wrote: Hi all, I've been trying out some stuff on my own local koji instance. Recently, I added a new builder and all the builds using SCMs started to fail (although, scratch builds on SRPMs work just fine). buildSRPMfromSCM fails. The checkouts go through fine and make sources also works. Following is the tail of the root.log (after make sources) DEBUG util.py:251: 3 2266k 73 1670k0 0 239k 0 0:00:09 0:00:06 0:00:03 310k 87 2266k 87 1976k0 0 247k 0 0:00:09 0:00:07 0:00:02 310k 100 2266k 100 2266k0 DEBUG util.py:251: DEBUG util.py:251: 0 DEBUG util.py:251: DEBUG util.py:251: DEBUG util.py:251: DEBUG util.py:251: 253k 0 0:00:08 0:00:08 --:--:-- 307k DEBUG util.py:251: -rw-rw-r-- 1 mockbuild mockbuild 2321402 Jun 18 2007 libidn-0.6.14.tar.gz DEBUG util.py:312: Child returncode was: 0 DEBUG backend.py:484: umount -n /var/lib/mock/dist-f10-build-139-697/root/proc DEBUG util.py:273: Executing command: umount -n /var/lib/mock/dist-f10-build-139-697/root/proc DEBUG util.py:312: Child returncode was: 0 DEBUG backend.py:484: umount -n /var/lib/mock/dist-f10-build-139-697/root/sys DEBUG util.py:273: Executing command: umount -n /var/lib/mock/dist-f10-build-139-697/root/sys DEBUG util.py:312: Child returncode was: 0 DEBUG util.py:99: kill orphans end of root.log The task exits with FAILED: BuildError: error building srpm, mock exited with status 2; see root.log for more information But, there is nothing suspicious in root.log (yum succeeds, so does checkout and make sources and there are no errors after that too). state.log and kojid.log also give out nothing. I have enabled full debugging from kojihub.conf. That error means mock --buildsrpm failed. I'm not sure what status 2 is, it probably means a failure in rpmbuild in the chroot. There should be more information in root.log, I'm not sure why there isn't. Does building the srpm by hand work? -- Fedora-buildsys-list mailing list Fedora-buildsys-list@redhat.com https://www.redhat.com/mailman/listinfo/fedora-buildsys-list
