Thanks Much Gaurav for detailed answers and support. It was helpful. Praba
From: Mishra, Gaurav <mishra.gau...@siemens.com> Sent: Wednesday, September 2, 2020 1:59 AM To: Devapraba Muthumani <dmuthum...@marvell.com>; fossol...@fossology.org Subject: [EXT] RE: [FOSSology] Not able to generate Copyright Report from Export List Tab External Email ________________________________ Hello Praba, Glad the issue was resolved. Coming to your questions: 1. For some components, some agents are missing from "Select additional analysis". > To improve scan times, FOSSology keeps record of which version or which agent > has already scanned which files. So, if you have already scanned a package by > copyright/nomos agent, and the scan was finished successfully, you can not > rescan the same upload from same scanner. > If you install a new version of FOSSology, the scanner version changes and > they become available again for rescans. 1. Files with different copyrights appears in different row in exported file. > This was done to help user identify the copyrights are from same file, at the > same time keeping the CSV format valid and simple. > We do not have any such plans right now. However, we are open for suggestions. 1. How FOSSology identifies licenses? > FOSSology currently uses 3 different agents working on 3 different methods to > identify licenses: * Nomos: nomos identifies licenses using regex and heuristics. You can read more about it at https://fossology.github.io/nomos.html<https://urldefense.proofpoint.com/v2/url?u=https-3A__fossology.github.io_nomos.html&d=DwMFAg&c=nKjWec2b6R0mOyPaz7xtfQ&r=KJB0MFJs12iJgk2DnHyxAa8-D57ve0YyZK1-kz0QxDc&m=t4vez9ic9OsEt-s1oQ_W0jeXiRKiF29Pv_pv3gl0PRc&s=0w5yJS1T095B7aAEUJD6zC6A5nacNP0b8EfJrj6uO7Y&e=> * Monk: monk is a full text scanner, matches everything from your license list. Read more at https://github.com/fossology/fossology/wiki/Monk<https://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_fossology_fossology_wiki_Monk&d=DwMFAg&c=nKjWec2b6R0mOyPaz7xtfQ&r=KJB0MFJs12iJgk2DnHyxAa8-D57ve0YyZK1-kz0QxDc&m=t4vez9ic9OsEt-s1oQ_W0jeXiRKiF29Pv_pv3gl0PRc&s=8wtr6hRPgbZIoA7UeQl1hYx_sB7uEDLgF0KVeDGlJU4&e=> * Ojo: ojo uses regex to identify SPDX license identifiers. 1. Files supported by FOSSology > While uploading an archive, FOSSology supports all major open formats. You > can find the list of supported formats which are unpacked recursively at > https://fossology.github.io/ununpack.html<https://urldefense.proofpoint.com/v2/url?u=https-3A__fossology.github.io_ununpack.html&d=DwMFAg&c=nKjWec2b6R0mOyPaz7xtfQ&r=KJB0MFJs12iJgk2DnHyxAa8-D57ve0YyZK1-kz0QxDc&m=t4vez9ic9OsEt-s1oQ_W0jeXiRKiF29Pv_pv3gl0PRc&s=Cdu7NUBN6tsawrP5KFPXM5oam3keAUiUqflUvYC-Q5s&e=> > Once everything is unpackaged, every file is will be scanned by all agents. > However, you can have an exclude list of files based on mimetypes. To set it > up: * Goto Admin > Customize * Provide the mimetypes in "Skip MimeTypes from scanning" * Then while uploading a new package, tick the "Ignore SCM files" checkbox (point no. 4) in upload page. Or provide the "ignoreScm" flag in REST API request. With best regards, Gaurav Mishra From: Devapraba Muthumani <dmuthum...@marvell.com<mailto:dmuthum...@marvell.com>> Sent: 02 September 2020 13:48 To: Mishra, Gaurav (CT RDA SSI ISF-IN) <mishra.gau...@siemens.com<mailto:mishra.gau...@siemens.com>>; fossol...@fossology.org<mailto:fossol...@fossology.org> Subject: RE: [FOSSology] Not able to generate Copyright Report from Export List Tab Thanks Mishra for the replay. * I tried to rerun by selecting the project from "upload to analyze" option -> Select additional analysis->"Copyright/Email/URL/Author Analysis" tab from GUI. Was able to get the report generated from export list tab and also could see the entries in Unified report. Additional Questions 1. For some component/project, I couldn't see Copyright/Email/URL/Author Analysis" option as highlighted below though they have multiple files with copyright. [cid:image001.png@01D6812E.B7719000] 1. From copyright report generated from export list tab, I see same file are listed in different rows for different copyright. Are there any future plan to group all the copyright in one row for specific file? /fs/nfsd/nfs4state.c /fs/nfsd/nfs4state.c /fs/nfsd/nfs4state.c 1. To identify a license, does Fossology look only for string/License name - example "GPL" and determines file license apart from checking license terms or URL(SPDX)? 2. Does Fossology scan all file extension types? Is there an option to skip specific file extension during scan - eg .pack(compressed jar files) etc. [.cfg, .dat , .patch, .cpp, .a, .mk, .m4, rst. Dts ,dtsi, .s, Makefile, makefile.in, makefile.am, .conf, Config.in, png, html, xml, js, .txt, .bin, .key, crt, .hash, srl, .csr, .in, .pc, .csv..] I will check for answer to few other questions in future mails. Thanks! Praba From: Mishra, Gaurav <mishra.gau...@siemens.com<mailto:mishra.gau...@siemens.com>> Sent: Tuesday, September 1, 2020 10:26 PM To: Devapraba Muthumani <dmuthum...@marvell.com<mailto:dmuthum...@marvell.com>>; fossol...@fossology.org<mailto:fossol...@fossology.org> Subject: [EXT] RE: [FOSSology] Not able to generate Copyright Report from Export List Tab External Email ________________________________ Hello Praba, I am not very sure what is happening here but the Copyright agent/User findings tab also shows Copyrights which are found on files with the same checksum in the server. But if the copyright agent has not ran on the upload before, the copyrights might not appear in Unified report and export list as well. Can you please try to schedule the copyright agent and see if it is working once the agent finishes? > Are there API commands to generate report from Export List. We do not have any endpoint for this right now, but there is an open issue for the same here: https://github.com/fossology/fossology/issues/1716<https://urldefense.proofpoint.com/v2/url?u=https-3A__eur01.safelinks.protection.outlook.com_-3Furl-3Dhttps-253A-252F-252Furldefense.proofpoint.com-252Fv2-252Furl-253Fu-253Dhttps-2D3A-5F-5Fgithub.com-5Ffossology-5Ffossology-5Fissues-5F1716-2526d-253DDwMFAg-2526c-253DnKjWec2b6R0mOyPaz7xtfQ-2526r-253DKJB0MFJs12iJgk2DnHyxAa8-2DD57ve0YyZK1-2Dkz0QxDc-2526m-253DJdkLPfE0tB-2DFFyngbcX02MHy-5FsvUv-5FjSGvpwmt9GnXg-2526s-253DBnQFJ27GdYhY-5FVFd9TjLLnsWJP-2DZkJ0VL3RnhoJs7nk-2526e-253D-26data-3D02-257C01-257Cmishra.gaurav-2540siemens.com-257C651946a72d204a5c80e308d84f18c8b4-257C38ae3bcd95794fd4addab42e1495d55a-257C1-257C0-257C637346315150876518-26sdata-3D9qJ8NDviqe6F9D4vDpQ7eQwJVKQFlVS8DeHdRcHR-252Ft8-253D-26reserved-3D0&d=DwMFAg&c=nKjWec2b6R0mOyPaz7xtfQ&r=KJB0MFJs12iJgk2DnHyxAa8-D57ve0YyZK1-kz0QxDc&m=t4vez9ic9OsEt-s1oQ_W0jeXiRKiF29Pv_pv3gl0PRc&s=eScaRxOzLFpN3rHMQgSx4iXt5LQCC8YyrM5elzsh8iA&e=> With best regards, Gaurav Mishra From: fossology@lists.fossology.org<mailto:fossology@lists.fossology.org> <fossology@lists.fossology.org<mailto:fossology@lists.fossology.org>> On Behalf Of Praba Sent: 02 September 2020 06:43 To: fossol...@fossology.org<mailto:fossol...@fossology.org> Subject: [FOSSology] Not able to generate Copyright Report from Export List Tab Dear Group, I am working in generating license and copyright report from Export List so I could have the list of files and the copyright and license for those files. I can generate License report from Export List tab for all the components but cannot generate Copyright report from Export List tab even though the license entries are seen from Copyright agent/User findings tab. Can you provide details? Your inputs will be helpful. Are there API commands to generate report from Export List. I saw the API command to download report but I think it is for Unified Report. Unified Report generated for that component/project also doesn't list the copyrights. Fossology Version used: FOSSology version 3.8.0-86 (In a docker environment) [cid:image002.jpg@01D6812E.B7719000] [cid:image003.jpg@01D6812E.B7719000] Thanks! Praba -=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#3394): https://lists.fossology.org/g/fossology/message/3394 Mute This Topic: https://lists.fossology.org/mt/76574408/21656 Group Owner: fossology+ow...@lists.fossology.org Unsubscribe: https://lists.fossology.org/g/fossology/unsub [arch...@mail-archive.com] -=-=-=-=-=-=-=-=-=-=-=-