Re: [FOSSology] Weird scan of fossology-1.3.0.tar.gz fails Package Scan

2011-02-15 Thread Jeroen Baten
Hello Vincent,

This issue is not that important that I need a workaround. 
I just tested the fossology program with its own tar file.
I just thought I mention the bug when it occured.

kind regards,


On Tue, 2011-02-15 at 08:31 +, Ma, Dong (Vincent,
ES-Best-Shore-Services-China-BJ) wrote:
> Jeroen, I didn't have an Fedora14 system for now, I need create one for 
> testing.
> 
> I can give you a workaround about this issue, you can use this sql to update 
> your database, and rerun pkgagent.
> 'UPDATE pfile SET pfile_mimetypefk=NULL WHERE pfile_pk=$pfile_pk; '  
> $pfile_pk is the pfile ID about this file, you can find from [info] page 
> about this file.
> 
> Thanks,
> Vincent
> 
> > -Original Message-
> > From: Jeroen Baten [mailto:jba...@onvz.nl]
> > Sent: Tuesday, February 15, 2011 4:13 PM
> > To: Ma, Dong (Vincent, ES-Best-Shore-Services-China-BJ)
> > Cc: fossology@fossology.org
> > Subject: RE: [FOSSology] Weird scan of fossology-1.3.0.tar.gz fails Package
> > Scan
> >
> > Fedora 14
> >
> > On Tue, 2011-02-15 at 08:11 +, Ma, Dong (Vincent,
> > ES-Best-Shore-Services-China-BJ) wrote:
> > > Hi Jeroen,
> > >
> > > In my test system(Debian Lenny), this file mimetype didn't recognize as '
> > application/x-rpm ', what's your system os?
> > >
> > > Thanks,
> > > Vincent
> > >
> > > > -Original Message-
> > > > From: fossology-boun...@fossology.org [mailto:fossology-
> > > > boun...@fossology.org] On Behalf Of Ma, Dong (Vincent,
> > > > ES-Best-Shore-
> > > > Services-China-BJ)
> > > > Sent: Tuesday, February 15, 2011 3:56 PM
> > > > To: Jeroen Baten
> > > > Cc: fossology@fossology.org
> > > > Subject: Re: [FOSSology] Weird scan of fossology-1.3.0.tar.gz fails
> > > > Package Scan
> > > >
> > > > Thanks Jeroen, I'll use this for debugging.
> > > >
> > > > Vincent
> > > >
> > > > > -Original Message-
> > > > > From: Jeroen Baten [mailto:jba...@onvz.nl]
> > > > > Sent: Tuesday, February 15, 2011 3:54 PM
> > > > > To: Ma, Dong (Vincent, ES-Best-Shore-Services-China-BJ)
> > > > > Cc: Gobeille, Robert; fossology@fossology.org
> > > > > Subject: RE: [FOSSology] Weird scan of fossology-1.3.0.tar.gz
> > > > > fails Package Scan
> > > > >
> > > > > So it is!
> > > > >
> > > > > Files associated with
> > > > >
> > > >
> > be9651c3d92b8a76fd3d0c03ff5597411e8ff860.a0fd8e3774fed62abeb6c2cda33
> > > > > 62862.2639
> > > > >
> > > > > 1:   Folder: Software Repository/
> > > > > Fossology_1_3_0/
> > > > >   Fossology_1_3_0/ fossology-1.3.0/ tests/ nomos/ testdata/
> > > > >   RedHat.tar.gz/
> > > > >   RedHat.tar/ RedHat/
> > > > >   perl-Mozilla-LDAP-1.5.2-4.el5.src.rpm/ Makefile.PL.rpm
> > > > >
> > > > >
> > > > > kind regards,
> > > > >
> > > > > On Tue, 2011-02-15 at 07:50 +, Ma, Dong (Vincent,
> > > > > ES-Best-Shore-Services-China-BJ) wrote:
> > > > > > Jeroen, I think you can use the 'search' menu, select the
> > > > > > 'Repository' micro-
> > > > > menu, enter the repository file name
> > > > >
> > > >
> > 'be9651c3d92b8a76fd3d0c03ff5597411e8ff860.a0fd8e3774fed62abeb6c2cda3
> > > > > 362862.2639' to search.
> > > > > >
> > > > > > Vincent
> > > > > >
> > > > > > > -Original Message-
> > > > > > > From: Jeroen Baten [mailto:jba...@onvz.nl]
> > > > > > > Sent: Tuesday, February 15, 2011 3:45 PM
> > > > > > > To: Ma, Dong (Vincent, ES-Best-Shore-Services-China-BJ)
> > > > > > > Cc: Gobeille, Robert; fossology@fossology.org
> > > > > > > Subject: RE: [FOSSology] Weird scan of fossology-1.3.0.tar.gz
> > > > > > > fails Package Scan
> > > > > > >
> > > > > > > Hello Vincent,
> > > > > > >
> > > > > > > Sending the file is easy. Knowing what it used to be is a
> > > > > > > little hardder. I guess I need a sql query for that info?
> > &g

Re: [FOSSology] Weird scan of fossology-1.3.0.tar.gz fails Package Scan

2011-02-15 Thread Jeroen Baten
Fedora 14

On Tue, 2011-02-15 at 08:11 +, Ma, Dong (Vincent,
ES-Best-Shore-Services-China-BJ) wrote:
> Hi Jeroen,
> 
> In my test system(Debian Lenny), this file mimetype didn't recognize as ' 
> application/x-rpm ', what's your system os?
> 
> Thanks,
> Vincent
> 
> > -Original Message-
> > From: fossology-boun...@fossology.org [mailto:fossology-
> > boun...@fossology.org] On Behalf Of Ma, Dong (Vincent, ES-Best-Shore-
> > Services-China-BJ)
> > Sent: Tuesday, February 15, 2011 3:56 PM
> > To: Jeroen Baten
> > Cc: fossology@fossology.org
> > Subject: Re: [FOSSology] Weird scan of fossology-1.3.0.tar.gz fails Package
> > Scan
> >
> > Thanks Jeroen, I'll use this for debugging.
> >
> > Vincent
> >
> > > -Original Message-
> > > From: Jeroen Baten [mailto:jba...@onvz.nl]
> > > Sent: Tuesday, February 15, 2011 3:54 PM
> > > To: Ma, Dong (Vincent, ES-Best-Shore-Services-China-BJ)
> > > Cc: Gobeille, Robert; fossology@fossology.org
> > > Subject: RE: [FOSSology] Weird scan of fossology-1.3.0.tar.gz fails
> > > Package Scan
> > >
> > > So it is!
> > >
> > > Files associated with
> > >
> > be9651c3d92b8a76fd3d0c03ff5597411e8ff860.a0fd8e3774fed62abeb6c2cda33
> > > 62862.2639
> > >
> > > 1:   Folder: Software Repository/
> > > Fossology_1_3_0/
> > >   Fossology_1_3_0/ fossology-1.3.0/ tests/ nomos/ testdata/
> > >   RedHat.tar.gz/
> > >   RedHat.tar/ RedHat/
> > >   perl-Mozilla-LDAP-1.5.2-4.el5.src.rpm/ Makefile.PL.rpm
> > >
> > >
> > > kind regards,
> > >
> > > On Tue, 2011-02-15 at 07:50 +, Ma, Dong (Vincent,
> > > ES-Best-Shore-Services-China-BJ) wrote:
> > > > Jeroen, I think you can use the 'search' menu, select the
> > > > 'Repository' micro-
> > > menu, enter the repository file name
> > >
> > 'be9651c3d92b8a76fd3d0c03ff5597411e8ff860.a0fd8e3774fed62abeb6c2cda3
> > > 362862.2639' to search.
> > > >
> > > > Vincent
> > > >
> > > > > -Original Message-
> > > > > From: Jeroen Baten [mailto:jba...@onvz.nl]
> > > > > Sent: Tuesday, February 15, 2011 3:45 PM
> > > > > To: Ma, Dong (Vincent, ES-Best-Shore-Services-China-BJ)
> > > > > Cc: Gobeille, Robert; fossology@fossology.org
> > > > > Subject: RE: [FOSSology] Weird scan of fossology-1.3.0.tar.gz
> > > > > fails Package Scan
> > > > >
> > > > > Hello Vincent,
> > > > >
> > > > > Sending the file is easy. Knowing what it used to be is a little
> > > > > hardder. I guess I need a sql query for that info?
> > > > >
> > > > > kind regards,
> > > > >
> > > > >
> > > > > On Tue, 2011-02-15 at 07:33 +, Ma, Dong (Vincent,
> > > > > ES-Best-Shore-Services-China-BJ) wrote:
> > > > > > Hi Jeroen,
> > > > > >
> > > > > > It's weird if the file is not an rpm file, the file mimetype should 
> > > > > > not be '
> > > > > application/x-rpm '.
> > > > > >
> > > > > > Can you send me the original file or the path in
> > > > > > fossology-1.3.0.tar.gz? Then
> > > > > I can debug this issue.
> > > > > >
> > > > > > Thanks,
> > > > > > Vincent
> > > > > >
> > > > > > > -Original Message-
> > > > > > > From: fossology-boun...@fossology.org [mailto:fossology-
> > > > > > > boun...@fossology.org] On Behalf Of Jeroen Baten
> > > > > > > Sent: Tuesday, February 15, 2011 3:06 PM
> > > > > > > To: Gobeille, Robert
> > > > > > > Cc: fossology@fossology.org
> > > > > > > Subject: Re: [FOSSology] Weird scan of fossology-1.3.0.tar.gz
> > > > > > > fails Package Scan
> > > > > > >
> > > > > > >
> > > > > > > root cause analyses: it is not an rpm file:
> > > > > > >
> > > > > > >
> > > > > > > [root@htn-ws-3092 jbaten]#
> > > &g

Re: [FOSSology] Weird scan of fossology-1.3.0.tar.gz fails Package Scan

2011-02-14 Thread Jeroen Baten
So it is!

Files associated with
be9651c3d92b8a76fd3d0c03ff5597411e8ff860.a0fd8e3774fed62abeb6c2cda3362862.2639

1:   Folder: Software Repository/ 
Fossology_1_3_0/ 
  Fossology_1_3_0/ fossology-1.3.0/ tests/ nomos/ testdata/ 
  RedHat.tar.gz/ 
  RedHat.tar/ RedHat/ 
  perl-Mozilla-LDAP-1.5.2-4.el5.src.rpm/ Makefile.PL.rpm


kind regards,

On Tue, 2011-02-15 at 07:50 +, Ma, Dong (Vincent,
ES-Best-Shore-Services-China-BJ) wrote:
> Jeroen, I think you can use the 'search' menu, select the 'Repository' 
> micro-menu, enter the repository file name 
> 'be9651c3d92b8a76fd3d0c03ff5597411e8ff860.a0fd8e3774fed62abeb6c2cda3362862.2639'
>  to search.
> 
> Vincent
> 
> > -Original Message-
> > From: Jeroen Baten [mailto:jba...@onvz.nl]
> > Sent: Tuesday, February 15, 2011 3:45 PM
> > To: Ma, Dong (Vincent, ES-Best-Shore-Services-China-BJ)
> > Cc: Gobeille, Robert; fossology@fossology.org
> > Subject: RE: [FOSSology] Weird scan of fossology-1.3.0.tar.gz fails Package
> > Scan
> > 
> > Hello Vincent,
> > 
> > Sending the file is easy. Knowing what it used to be is a little hardder. I 
> > guess
> > I need a sql query for that info?
> > 
> > kind regards,
> > 
> > 
> > On Tue, 2011-02-15 at 07:33 +, Ma, Dong (Vincent,
> > ES-Best-Shore-Services-China-BJ) wrote:
> > > Hi Jeroen,
> > >
> > > It's weird if the file is not an rpm file, the file mimetype should not 
> > > be '
> > application/x-rpm '.
> > >
> > > Can you send me the original file or the path in fossology-1.3.0.tar.gz? 
> > > Then
> > I can debug this issue.
> > >
> > > Thanks,
> > > Vincent
> > >
> > > > -Original Message-
> > > > From: fossology-boun...@fossology.org [mailto:fossology-
> > > > boun...@fossology.org] On Behalf Of Jeroen Baten
> > > > Sent: Tuesday, February 15, 2011 3:06 PM
> > > > To: Gobeille, Robert
> > > > Cc: fossology@fossology.org
> > > > Subject: Re: [FOSSology] Weird scan of fossology-1.3.0.tar.gz fails
> > > > Package Scan
> > > >
> > > >
> > > > root cause analyses: it is not an rpm file:
> > > >
> > > >
> > > > [root@htn-ws-3092 jbaten]#  /usr/local/lib/fossology/agents/pkgagent
> > > > -v
> > > > /srv/fossology/repository/localhost/files/be/96/51/be9651c3d92b8a76f
> > > > d3d0
> > > > c03ff5597411e8ff860.a0fd8e3774fed62abeb6c2cda3362862.2639
> > > > error:
> > > > /srv/fossology/repository/localhost/files/be/96/51/be9651c3d92b8a76f
> > > > d3d0
> > > > c03ff5597411e8ff860.a0fd8e3774fed62abeb6c2cda3362862.2639 cannot
> > be
> > > > read or is not an RPM.
> > > > [root@htn-ws-3092 jbaten]#
> > > > file
> > > > /srv/fossology/repository/localhost/files/be/96/51/be9651c3d92b8a76f
> > > > d3d0
> > > > c03ff5597411e8ff860.a0fd8e3774fed62abeb6c2cda3362862.2639
> > > > /srv/fossology/repository/localhost/files/be/96/51/be9651c3d92b8a76f
> > > > d3d0
> > > > c03ff5597411e8ff860.a0fd8e3774fed62abeb6c2cda3362862.2639: ASCII
> > > > English text
> > > > [root@htn-ws-3092 jbaten]# head
> > > > -30l
> > > > /srv/fossology/repository/localhost/files/be/96/51/be9651c3d92b8a76f
> > > > d3d0
> > > > c03ff5597411e8ff860.a0fd8e3774fed62abeb6c2cda3362862.2639
> > > >
> > ##
> > > > ###
> > > > # $Id: Makefile.PL.rpm,v 1.1.2.1 2007/01/10 18:01:48 richm%
> > > > stanfordalumni.org Exp $ # # The contents of this file are subject
> > > > to the Mozilla Public License # Version 1.1 (the "License"); you may
> > > > not use this file except in # compliance with the License. You may
> > > > obtain a copy of the License at # http://www.mozilla.org/MPL/ # #
> > > > Software distributed under the License is distributed on an "AS IS"
> > > > # basis, WITHOUT WARRANTY OF ANY KIND, either express or implied.
> > > > See the # License for the specific language governing rights and
> > > > limitations # under the License.
> > > > #
> > > > # The Original Code is PerLDAP. The Initial Developer of the
> > > > Original # Code is Netscape Communications Corp. and Clayton Donley.
> > > > Portions # created by Netscape are Copyright (C) Ne

Re: [FOSSology] Weird scan of fossology-1.3.0.tar.gz fails Package Scan

2011-02-14 Thread Jeroen Baten
Hello Vincent,

Sending the file is easy. Knowing what it used to be is a little
hardder. I guess I need a sql query for that info?

kind regards,


On Tue, 2011-02-15 at 07:33 +, Ma, Dong (Vincent,
ES-Best-Shore-Services-China-BJ) wrote:
> Hi Jeroen,
> 
> It's weird if the file is not an rpm file, the file mimetype should not be ' 
> application/x-rpm '.
> 
> Can you send me the original file or the path in fossology-1.3.0.tar.gz? Then 
> I can debug this issue.
> 
> Thanks,
> Vincent
> 
> > -Original Message-
> > From: fossology-boun...@fossology.org [mailto:fossology-
> > boun...@fossology.org] On Behalf Of Jeroen Baten
> > Sent: Tuesday, February 15, 2011 3:06 PM
> > To: Gobeille, Robert
> > Cc: fossology@fossology.org
> > Subject: Re: [FOSSology] Weird scan of fossology-1.3.0.tar.gz fails Package
> > Scan
> > 
> > 
> > root cause analyses: it is not an rpm file:
> > 
> > 
> > [root@htn-ws-3092 jbaten]#  /usr/local/lib/fossology/agents/pkgagent
> > -v
> > /srv/fossology/repository/localhost/files/be/96/51/be9651c3d92b8a76fd3d0
> > c03ff5597411e8ff860.a0fd8e3774fed62abeb6c2cda3362862.2639
> > error:
> > /srv/fossology/repository/localhost/files/be/96/51/be9651c3d92b8a76fd3d0
> > c03ff5597411e8ff860.a0fd8e3774fed62abeb6c2cda3362862.2639 cannot be
> > read or is not an RPM.
> > [root@htn-ws-3092 jbaten]#
> > file
> > /srv/fossology/repository/localhost/files/be/96/51/be9651c3d92b8a76fd3d0
> > c03ff5597411e8ff860.a0fd8e3774fed62abeb6c2cda3362862.2639
> > /srv/fossology/repository/localhost/files/be/96/51/be9651c3d92b8a76fd3d0
> > c03ff5597411e8ff860.a0fd8e3774fed62abeb6c2cda3362862.2639: ASCII
> > English text
> > [root@htn-ws-3092 jbaten]# head
> > -30l
> > /srv/fossology/repository/localhost/files/be/96/51/be9651c3d92b8a76fd3d0
> > c03ff5597411e8ff860.a0fd8e3774fed62abeb6c2cda3362862.2639
> > ##
> > ###
> > # $Id: Makefile.PL.rpm,v 1.1.2.1 2007/01/10 18:01:48 richm%
> > stanfordalumni.org Exp $ # # The contents of this file are subject to the
> > Mozilla Public License # Version 1.1 (the "License"); you may not use this 
> > file
> > except in # compliance with the License. You may obtain a copy of the
> > License at # http://www.mozilla.org/MPL/ # # Software distributed under
> > the License is distributed on an "AS IS"
> > # basis, WITHOUT WARRANTY OF ANY KIND, either express or implied. See
> > the # License for the specific language governing rights and limitations #
> > under the License.
> > #
> > # The Original Code is PerLDAP. The Initial Developer of the Original # 
> > Code is
> > Netscape Communications Corp. and Clayton Donley. Portions # created by
> > Netscape are Copyright (C) Netscape Communications # Corp., portions
> > created by Clayton Donley are Copyright (C) Clayton # Donley, portions
> > created by Leif Hedstrom are Copyright (C) Leif # Hedstrom. All Rights
> > Reserved.
> > #
> > # Contributor(s):
> > #* Leif Hedstrom 
> > #
> > # DESCRIPTION
> > #The Makefile "source".
> > #This has been heavily modified to simply use pkg-config
> > #to get the components necessary to build.
> > #
> > ##
> > ###
> > 
> > [root@htn-ws-3092 jbaten]#
> > 
> > 
> > 
> > On Fri, 2011-02-11 at 10:32 -0700, Bob Gobeille wrote:
> > > Whoops I didn't read the bug carefully and was mixing this up with bug
> > > 636.
> > >
> > >
> > > Jeroen, if the file is from a public upload, could you give us the
> > > URL?  If not, could you run the pkgagent standalone on the file it
> > > crashed on?  The basic syntax is:
> > >
> > > pkgagent -v my.rpm
> > >
> > >
> > > pkgagent is installed in either /usr/local/lib/fossology/agents or
> > > /usr/lib/fossology/agents.
> > > The file it crashed on is in your repository.  So first you need to
> > > find the repository:
> > >
> > >
> > > cat /usr/local/etc/fossology/RepPath.conf
> > > or
> > > cat /etc/fossology/RepPath.conf
> > >
> > >
> > > For example, let's say your repository is in /srv/fossology/repository
> > > and is only on a single host.  Then the file to pass to pkgagent is:
> > >
> > >
> > > /srv/fossology/repository/localhost/files/be/96/51/BE9651C3D92

Re: [FOSSology] Weird scan of fossology-1.3.0.tar.gz fails Package Scan

2011-02-14 Thread Jeroen Baten

root cause analyses: it is not an rpm file:


[root@htn-ws-3092 jbaten]#  /usr/local/lib/fossology/agents/pkgagent
-v 
/srv/fossology/repository/localhost/files/be/96/51/be9651c3d92b8a76fd3d0c03ff5597411e8ff860.a0fd8e3774fed62abeb6c2cda3362862.2639
error: 
/srv/fossology/repository/localhost/files/be/96/51/be9651c3d92b8a76fd3d0c03ff5597411e8ff860.a0fd8e3774fed62abeb6c2cda3362862.2639
 cannot be read or is not an RPM.
[root@htn-ws-3092 jbaten]#
file 
/srv/fossology/repository/localhost/files/be/96/51/be9651c3d92b8a76fd3d0c03ff5597411e8ff860.a0fd8e3774fed62abeb6c2cda3362862.2639
/srv/fossology/repository/localhost/files/be/96/51/be9651c3d92b8a76fd3d0c03ff5597411e8ff860.a0fd8e3774fed62abeb6c2cda3362862.2639:
 ASCII English text
[root@htn-ws-3092 jbaten]# head
-30l 
/srv/fossology/repository/localhost/files/be/96/51/be9651c3d92b8a76fd3d0c03ff5597411e8ff860.a0fd8e3774fed62abeb6c2cda3362862.2639
#
# $Id: Makefile.PL.rpm,v 1.1.2.1 2007/01/10 18:01:48 richm%
stanfordalumni.org Exp $
#
# The contents of this file are subject to the Mozilla Public License
# Version 1.1 (the "License"); you may not use this file except in
# compliance with the License. You may obtain a copy of the License at
# http://www.mozilla.org/MPL/
#
# Software distributed under the License is distributed on an "AS IS"
# basis, WITHOUT WARRANTY OF ANY KIND, either express or implied. See
the
# License for the specific language governing rights and limitations
# under the License.
#
# The Original Code is PerLDAP. The Initial Developer of the Original
# Code is Netscape Communications Corp. and Clayton Donley. Portions
# created by Netscape are Copyright (C) Netscape Communications
# Corp., portions created by Clayton Donley are Copyright (C) Clayton
# Donley, portions created by Leif Hedstrom are Copyright (C) Leif
# Hedstrom. All Rights Reserved.
#
# Contributor(s):
#* Leif Hedstrom 
#
# DESCRIPTION
#The Makefile "source".
#This has been heavily modified to simply use pkg-config
#to get the components necessary to build.
#
#

[root@htn-ws-3092 jbaten]# 



On Fri, 2011-02-11 at 10:32 -0700, Bob Gobeille wrote:
> Whoops I didn't read the bug carefully and was mixing this up with bug
> 636.
> 
> 
> Jeroen, if the file is from a public upload, could you give us the
> URL?  If not, could you run the pkgagent standalone on the file it
> crashed on?  The basic syntax is:
>   
> pkgagent -v my.rpm
> 
> 
> pkgagent is installed in either /usr/local/lib/fossology/agents
> or /usr/lib/fossology/agents.
> The file it crashed on is in your repository.  So first you need to
> find the repository:
> 
> 
> cat /usr/local/etc/fossology/RepPath.conf
> or
> cat /etc/fossology/RepPath.conf
> 
> 
> For example, let's say your repository is in /srv/fossology/repository
> and is only on a single host.  Then the file to pass to pkgagent is:
> 
> 
> /srv/fossology/repository/localhost/files/be/96/51/BE9651C3D92B8A76FD3D0C03FF5597411E8FF860.A0FD8E3774FED62ABEB6C2CDA3362862.2639
> 
> 
> Thanks,
> Bob Gobeille
> 
> 
> 
> On Feb 11, 2011, at 9:15 AM, Laser, Mary wrote:
> 
> > The fix for the bug referenced below (#596) is in 1.3.0.  However, I
> > don't think that bug is the same problem Jeroen is having, based on
> > what I see below.  The problem description for #596 includes:
> >  
> > On fedora/rhel system, ununpack agent get the wrong mimetype for
> > debian binary
> > package, it set debian binary packages as
> > application/x-7z-w-compressed, so
> > pkgagent didn't process these debian binary packages and cannot get
> > the package
> > info.
> >  
> > The problem below shows the pkgagent dying.
> >  
> > Mary
> >  
> >  
> >  
> > > -Original Message-
> > > From: Gobeille, Robert
> > > Sent: Friday, February 11, 2011 7:23 AM
> > > To: Jeroen Baten; Laser, Mary
> > > Cc: fossology@fossology.org
> > > Subject: Re: [FOSSology] Weird scan of fossology-1.3.0.tar.gz
> > fails
> > > Package Scan
> > >
> > > This was supposed to be fixed on January 13.
> > > http://bugs.linux-foundation.org/show_bug.cgi?id=596
> > >
> > > 1.3.0 was released January 19.  Mary, did this fix get into 1.3.0?
> > >
> > > Bob Gobeille
> > >
> > > On Feb 11, 2011, at 1:47 AM, Jeroen Baten wrote:
> > >
> > > > Don't know if this helps, but this is a relevant piece of the
> > log:
> > > >
> > > > 2011-02-10 13:42:27 scheduler[716] : Child[15] 'agent=

Re: [FOSSology] Weird scan of fossology-1.3.0.tar.gz fails Package Scan

2011-02-11 Thread Jeroen Baten
Don't know if this helps, but this is a relevant piece of the log:

2011-02-10 13:42:27 scheduler[716] : Child[15] 'agent=pkgagent
host=localhost ' state=SPAWNED(4) @ Thu Feb 10 13:42:27 2011
2011-02-10 13:42:27 scheduler[716] : Child[15] 'agent=pkgagent
host=localhost ' state=READY(5) @ Thu Feb 10 13:42:27 2011
2011-02-10 13:42:27 scheduler[716] : Child[6] 'agent=buckets
host=localhost ' state=FREE(1) @ Thu Feb 10 13:42:27 2011
2011-02-10 13:45:52 scheduler[716] : ERROR: Child[15] died prematurely
(was state RUNNING, signal was 11)
2011-02-10 13:45:52 scheduler[716] : 
Thread 15:
2011-02-10 13:45:52 scheduler[716] :   PID:   1736
2011-02-10 13:45:52 scheduler[716] :   Pipes: in=8->9 / out=13->12
2011-02-10 13:45:52 scheduler[716] :   Attr:  'agent=pkgagent
host=localhost '
2011-02-10 13:45:52 scheduler[716] :   Command:
'/usr/local/lib/fossology/agents/pkgagent'
2011-02-10 13:45:52 scheduler[716] :   Parm:  'pfile_pk="87202"
pfilename="BE9651C3D92B8A76FD3D0C03FF5597411E8FF860.A0FD8E3774FED62ABEB6C2CDA3362862.2639"
 mimetype="application/x-rpm"
'
2011-02-10 13:45:52 scheduler[716] :   Heartbeat:  Thu Feb 10 13:45:42
2011
2011-02-10 13:45:52 scheduler[716] :   State:  Thu Feb 10 13:45:42
2011
2011-02-10 13:45:52 scheduler[716] :   Status: 6 (RUNNING)
2011-02-10 13:45:52 scheduler[716] :   Spawn:  1 at Thu Feb 10
13:42:27 2011
2011-02-10 13:45:52 scheduler[716] :   DB:
2011-02-10 13:45:52 scheduler[716] : IsDB: 2
2011-02-10 13:45:52 scheduler[716] : DBJobKey: 128
2011-02-10 13:45:52 scheduler[716] : DBMSQrow: 1
2011-02-10 13:45:52 scheduler[716] : DBagent:  29
2011-02-10 13:45:52 scheduler[716] : Child[15] 'agent=pkgagent
host=localhost ' state=FREEING(2) @ Thu Feb 10 13:45:52 2011
2011-02-10 13:45:52 scheduler[716] : Child[15] 'agent=pkgagent
host=localhost ' state=FREE(1) @ Thu Feb 10 13:45:52 2011


On Thu, 2011-02-10 at 11:37 -0700, Bob Gobeille wrote:
> Hi Jeroen,
> The best place to see why an agent failed is in the fossology log file 
> (/var/log/fossology/fossology.log).
> If you look there and see a "spawning too fast" error, that is a known 
> (major) bug.  See:
> 
> http://bugs.linux-foundation.org/show_bug.cgi?id=636
> 
> If it is something different than what is in the bug report, please let us 
> know.
> 
> Thanks,
> Bob Gobeille
> 
> 
> On Feb 10, 2011, at 5:49 AM, Jeroen Baten wrote:
> 
> > 
> > This is the info I found. Maybe it helps you people.
> > 
> > 
> > Kind regards, Jeroen Baten
> > 
> > jq_pk   128
> > jq_job_fk   108
> > job_namePackage Scan
> > jq_type pkgagent
> > job_priority0
> > jq_args SELECT pfile_pk as pfile_pk, pfile_sha1 || '.' || pfile_md5 ||
> > '.' || pfile_size AS pfilename, mimetype_name AS mimetype FROM
> > uploadtree INNER JOIN pfile ON upload_fk = '7' INNER JOIN mimetype ON
> > (mimetype_pk = '1' OR mimetype_pk = '2' OR mimetype_pk = '3') AND
> > uploadtree.pfile_fk = pfile_pk AND pfile.pfile_mimetypefk =
> > mimetype.mimetype_pk AND pfile_pk NOT IN (SELECT pkg_rpm.pfile_fk FROM
> > pkg_rpm) AND pfile_pk NOT IN (SELECT pkg_deb.pfile_fk FROM pkg_deb)
> > LIMIT 5000;
> > jq_runonpfile   pfile_pk
> > jq_starttime2011-02-10 13:45:42.098366+01
> > jq_endtime  2011-02-10 13:45:52.166725+01
> > jq_end_bits 2
> > jq_endtext  Failed: Failed: Agent terminated prematurely
> > jq_elapsedtime  00:02:44
> > jq_processedtime00:00:01
> > jq_itemsprocessed   29
> > job_submitter   
> > job_queued  2011-02-10 13:40:11.799265+01
> > job_email_notifyfossy
> > job_upload_fk   7
> > depends on  40
> > required by 127, 129
> > ___
> > fossology mailing list
> > fossology@fossology.org
> > http://fossology.org/mailman/listinfo/fossology
> 

___
fossology mailing list
fossology@fossology.org
http://fossology.org/mailman/listinfo/fossology


Re: [FOSSology] Wondering which are OSI approved licenses

2011-02-11 Thread Jeroen Baten
Hi,

I found the page on buckets and see that it is a 'work in progess'.
No problem. I will see if I can help. Thanks for the heads-up.

kind regards,

On Thu, 2011-02-10 at 20:36 +0200, Raino Lintulampi wrote:
> Hi Jeroen,
> I think buckets are what you are looking for. With  buckets you can classify
> licenses as you want f.ex. for OSI approved, and with colors.
> 
> br Raino

___
fossology mailing list
fossology@fossology.org
http://fossology.org/mailman/listinfo/fossology


[FOSSology] Wondering which are OSI approved licenses

2011-02-10 Thread Jeroen Baten
Hello,

I was wondering. The nomos license list shows me all licenses found,
right?

But do I need to know which of these is OSI approved?
Or is there a way to color those licenses in this list?

It would make life a lot simpler for a license compliance officer.

kind regards,

Jeroen Baten
___
fossology mailing list
fossology@fossology.org
http://fossology.org/mailman/listinfo/fossology


[FOSSology] Weird scan of fossology-1.3.0.tar.gz fails Package Scan

2011-02-10 Thread Jeroen Baten

This is the info I found. Maybe it helps you people.


Kind regards, Jeroen Baten

jq_pk   128
jq_job_fk   108
job_namePackage Scan
jq_type pkgagent
job_priority0
jq_args SELECT pfile_pk as pfile_pk, pfile_sha1 || '.' || pfile_md5 ||
'.' || pfile_size AS pfilename, mimetype_name AS mimetype FROM
uploadtree INNER JOIN pfile ON upload_fk = '7' INNER JOIN mimetype ON
(mimetype_pk = '1' OR mimetype_pk = '2' OR mimetype_pk = '3') AND
uploadtree.pfile_fk = pfile_pk AND pfile.pfile_mimetypefk =
mimetype.mimetype_pk AND pfile_pk NOT IN (SELECT pkg_rpm.pfile_fk FROM
pkg_rpm) AND pfile_pk NOT IN (SELECT pkg_deb.pfile_fk FROM pkg_deb)
LIMIT 5000;
jq_runonpfile   pfile_pk
jq_starttime2011-02-10 13:45:42.098366+01
jq_endtime  2011-02-10 13:45:52.166725+01
jq_end_bits 2
jq_endtext  Failed: Failed: Agent terminated prematurely
jq_elapsedtime  00:02:44
jq_processedtime00:00:01
jq_itemsprocessed   29
job_submitter   
job_queued  2011-02-10 13:40:11.799265+01
job_email_notifyfossy
job_upload_fk   7
depends on  40
required by 127, 129
___
fossology mailing list
fossology@fossology.org
http://fossology.org/mailman/listinfo/fossology


[FOSSology] spontaneous user feedback on 1.3.0

2011-02-09 Thread Jeroen Baten
Hi,

I'm a fossology newbie and thought maybe you all would like some user
feedback. 

(probably not but since your are reading this sofar, it's to late! :-)

primary feedback: I love this tool! How can I help?

question: someone told me about 'maven site' that show licensing
information. I have the feeling Fossology is better but I lack the
arguments. Can you help?

Features wanted:
===
-Guestimations in the job details screen. Great that I am analyzing a
gazillion files, but when will it end approximately?
-Did I already mention guestimations? :-)
-Why am I seeing the contents of a binary in the 'browse' screen? Maybe
a warning 'are your sure' beforehand?
-in job screen links to short help on text in 2nd column would be great
for newbie. What is this step doing?
-in job screen: links in "Queued Scheduled  Running Finished Blocked
Failed" to show only those type jobs.
-My first mistake was uploading a binary file. Don't know how to prevent
that one though.
-upload direct from subversion and also download sources of dependencies
(maven libs and stuf)
-hudson plugin 
-nagios check: job with id X only found known open source licenses means
status green. found unknown license: staus orange. Found known closed
source license: status red.


Errors encountered in php and query code:
===
-I don't know it they are big, but here's my syslog:
I dedoubled stuff but maybe missed 1 or 2.

Feb  9 09:20:26 htn-ws-3092 httpd: PHP Notice:  Undefined index:
SERVER_NAME in /usr/local/share/fossology/www/plugins/myjobs.php on line
136

Feb  9 09:31:04 htn-ws-3092 httpd: PHP Notice:  Undefined index:
upload_filename
in /usr/local/share/fossology/www/plugins/admin-upload-edit.php on line
170

Feb  9 09:31:04 htn-ws-3092 httpd: PHP Notice:  Undefined index:
upload_desc
in /usr/local/share/fossology/www/plugins/admin-upload-edit.php on line
173
Feb  9 09:31:15 htn-ws-3092 httpd: PHP Notice:  Undefined index:
SERVER_NAME in /usr/local/share/fossology/www/plugins/myjobs.php on line
136


Feb  9 09:35:43 htn-ws-3092 httpd: PHP Notice:  Undefined index: licfile
in /usr/local/share/fossology/www/plugins/agent-nomos-once.php on line
241

Feb  9 09:35:58 htn-ws-3092 postgres[29401]: [2-1] 2011-02-09 09:35:58
CET ::1 4d524b2d.72d9ERROR:  prepared statement
"FolderGetFromUpload_1_exported" already exists

Feb  9 09:35:58 htn-ws-3092 postgres[29401]: [2-2] 2011-02-09 09:35:58
CET ::1 4d524b2d.72d9STATEMENT:  SELECT parent_fk,folder_name FROM
foldercontents
Feb  9 09:35:58 htn-ws-3092 postgres[29401]: [2-3] #011#011#011#011
INNER JOIN folder ON foldercontents.parent_fk = folder.folder_pk
Feb  9 09:35:58 htn-ws-3092 postgres[29401]: [2-4] #011#011#011#011  AND
foldercontents.foldercontents_mode = 2
Feb  9 09:35:58 htn-ws-3092 postgres[29401]: [2-5] #011#011#011#011
WHERE foldercontents.child_id = $1 LIMIT 1;
Feb  9 09:36:50 htn-ws-3092 postgres[29401]: [3-1] 2011-02-09 09:36:50
CET ::1 4d524b2d.72d9ERROR:  prepared statement
"FolderGetFromUpload_1_exported" already exists
Feb  9 09:36:50 htn-ws-3092 postgres[29401]: [3-2] 2011-02-09 09:36:50
CET ::1 4d524b2d.72d9STATEMENT:  SELECT parent_fk,folder_name FROM
foldercontents
Feb  9 09:37:13 htn-ws-3092 httpd: PHP Notice:  Undefined variable:
Offset in /usr/local/share/fossology/www/common/common-license.php on
line 441
Feb  9 09:37:13 htn-ws-3092 httpd: PHP Notice:  Undefined variable: Max
in /usr/local/share/fossology/www/common/common-license.php on line 446
Feb  9 09:37:15 htn-ws-3092 httpd: PHP Notice:  Undefined index: id
in /usr/local/share/fossology/www/plugins/ui-licgroup.php on line 132
Feb  9 09:37:15 htn-ws-3092 httpd: PHP Notice:  Undefined index: l1
in /usr/local/share/fossology/www/plugins/ui-licgroup.php on line 131
Feb  9 09:37:15 htn-ws-3092 httpd: PHP Notice:  Undefined index: color
in /usr/local/share/fossology/www/plugins/ui-licgroup.php on line 132
Feb  9 09:37:15 htn-ws-3092 httpd: PHP Notice:  Undefined index: name
in /usr/local/share/fossology/www/plugins/ui-licgroup.php on line 132
Feb  9 09:37:15 htn-ws-3092 httpd: PHP Notice:  Undefined index: tail
in /usr/local/share/fossology/www/plugins/ui-licgroup.php on line 131
Feb  9 09:37:15 htn-ws-3092 httpd: PHP Notice:  Undefined index: count
in /usr/local/share/fossology/www/plugins/ui-licgroup.php on line 131
Feb  9 09:37:15 htn-ws-3092 httpd: PHP Notice:  Undefined index: head
in /usr/local/share/fossology/www/plugins/ui-licgroup.php on line 131
Feb  9 10:28:57 htn-ws-3092 httpd: PHP Notice:  Undefined variable: Uri
in /usr/local/share/fossology/www/plugins/upload-instructions.php on
line 62

___
fossology mailing list
fossology@fossology.org
http://fossology.org/mailman/listinfo/fossology


[FOSSology] compile gives error. Where to look?

2011-02-08 Thread Jeroen Baten
Hello,

The compile of 1.3.0 on fedora core 13 fails with an error (duh).
But where should I look for the solution to this?

kind regards,
Jeroen Baten

[jbaten@htn-ws-3092 fossology-1.3.0]$ make
make -C devel
make[1]: Entering directory
`/home/local/ONVZ/jbaten/src/java/license-check/fossology-1.3.0/devel'
make -C libfossdb
make[2]: Entering directory
`/home/local/ONVZ/jbaten/src/java/license-check/fossology-1.3.0/devel/libfossdb'
gcc -c libfossdb.c -DFOSSDB_CONF='"/usr/local/etc/fossology/Db.conf"'
-I`pg_config --includedir` -fPIC -DSVN_REV="\"1.3.0, exported\"" -g -O2
-Wall
ar cr libfossdb.a libfossdb.o
gcc dbtest.c -lpq -I`pg_config --includedir` -I../../devel/libfossdb
-L../../devel/libfossdb -lfossdb -I`pg_config --includedir` -o dbtest
gcc dbq.c -lpq -I`pg_config --includedir` -I../../devel/libfossdb
-L../../devel/libfossdb -lfossdb -I`pg_config --includedir` -o dbq
gcc dbcheck.c -lpq -I`pg_config --includedir` -I../../devel/libfossdb
-L../../devel/libfossdb -lfossdb -I`pg_config --includedir` -o dbcheck
make[2]: Leaving directory
`/home/local/ONVZ/jbaten/src/java/license-check/fossology-1.3.0/devel/libfossdb'
make -C libfossrepo
make[2]: Entering directory
`/home/local/ONVZ/jbaten/src/java/license-check/fossology-1.3.0/devel/libfossrepo'
gcc -c libfossrepo.c -DFOSSREPO_CONF='"/usr/local/etc/fossology"'
-DFOSSGROUP='"fossy"' -fPIC -DSVN_REV="\"1.3.0, exported\"" -g -O2 -Wall
ar cr libfossrepo.a libfossrepo.o
gcc reppath.c -I../../devel/libfossrepo -L../../devel/libfossrepo
-lfossrepo -o reppath
gcc repwrite.c -I../../devel/libfossrepo -L../../devel/libfossrepo
-lfossrepo -o repwrite
gcc repcat.c -I../../devel/libfossrepo -L../../devel/libfossrepo
-lfossrepo -o repcat
gcc repexist.c -I../../devel/libfossrepo -L../../devel/libfossrepo
-lfossrepo -o repexist
gcc repcopyin.c -I../../devel/libfossrepo -L../../devel/libfossrepo
-lfossrepo -o repcopyin
gcc repremove.c -I../../devel/libfossrepo -L../../devel/libfossrepo
-lfossrepo -o repremove
gcc rephost.c -I../../devel/libfossrepo -L../../devel/libfossrepo
-lfossrepo -o rephost
gcc repmmapcheck.c -I../../devel/libfossrepo -L../../devel/libfossrepo
-lfossrepo -o repmmapcheck
make[2]: Leaving directory
`/home/local/ONVZ/jbaten/src/java/license-check/fossology-1.3.0/devel/libfossrepo'
make -C libfossagent
make[2]: Entering directory
`/home/local/ONVZ/jbaten/src/java/license-check/fossology-1.3.0/devel/libfossagent'
gcc -c libfossagent.c -I`pg_config --includedir` -I../../devel/libfossdb
-L../../devel/libfossdb -lfossdb -I../../devel/libfossrepo
-L../../devel/libfossrepo -lfossrepo -fPIC -DSVN_REV="\"1.3.0, exported
\"" -g -O2 -Wall
ar cr libfossagent.a libfossagent.o
make[2]: Leaving directory
`/home/local/ONVZ/jbaten/src/java/license-check/fossology-1.3.0/devel/libfossagent'
make -C libfosspython
make[2]: Entering directory
`/home/local/ONVZ/jbaten/src/java/license-check/fossology-1.3.0/devel/libfosspython'
python setup.py build_ext --inplace
running build_ext
pyrexc libfosspython.pyx --> libfosspython.c
/home/local/ONVZ/jbaten/src/java/license-check/fossology-1.3.0/devel/libfosspython/libfosspython.pyx:156:4:
 __new__ method of extension type will change semantics in a future version of 
Pyrex. Use __cinit__ instead.
building 'libfosspython' extension
creating build
creating build/temp.linux-x86_64-2.7
gcc -pthread -fno-strict-aliasing -O2 -g -pipe -Wall
-Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector
--param=ssp-buffer-size=4 -m64 -mtune=generic -D_GNU_SOURCE -fPIC
-fwrapv -DNDEBUG -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions
-fstack-protector --param=ssp-buffer-size=4 -m64 -mtune=generic
-D_GNU_SOURCE -fPIC -fwrapv -fPIC -I/usr/include/postgresql
-I/usr/include/python2.7 -c libfosspython.c -o
build/temp.linux-x86_64-2.7/libfosspython.o
libfosspython.c:1:2: error: #error Do not use this file, it is the
result of a failed Pyrex compilation.
error: command 'gcc' failed with exit status 1
make[2]: *** [libfosspython.so] Error 1
make[2]: Leaving directory
`/home/local/ONVZ/jbaten/src/java/license-check/fossology-1.3.0/devel/libfosspython'
make[1]: *** [build-libfosspython] Error 2
make[1]: Leaving directory
`/home/local/ONVZ/jbaten/src/java/license-check/fossology-1.3.0/devel'
make: *** [build-devel] Error 2
[jbaten@htn-ws-3092 fossology-1.3.0]$
___
fossology mailing list
fossology@fossology.org
http://fossology.org/mailman/listinfo/fossology