Hello, so, did the postgresql optimization work for you? Forgot to mention that key is a different work_mem setting, which could be 64MB in your case. Note that for every DB connection this amount is occpied, so if you have 200 DB connections ...
As for the cumbersome file-by-file handling. There are several techniques for this. I think you should not go by files, but by identified license statements. You can find them in the overview page for showing license results on the left side (the kind of histogram view for showing different identified license statement.) But, as for the number of license statements, if you need to provide conclusions, you would need to check every different unconventional license statement. You can select entire folders and set conclusions for all files of the containing folder if you click the "Edit" link at the right end of each row. The appearing dialog lets you set the license(es) you would like to conclude for this subtree. You can choose as many licenses as you wish in the edit view, I think the interface is obvious there. For Dual license you need to additionally set the "Dual-License" conclusion in addition to all licenses being part of the license option to tell fossology this is not an AND but an OR conclusion of involved licenses. Kind regards, Michael On 06.09.19, 11:53, "[email protected] on behalf of Daniels, Hans-Joachim" <[email protected] on behalf of [email protected]> wrote: Good Morning, > I think it is safe to say that FOSSology was designed for working with entire distros from the beginning on. (Dan?) This gives me hope, thanks. > but you need to change your postgresql setup. I will try that and report back. >> In addition, I couldn’t find a way to select multiple files at once to assign licenses with fewer clicks and therefore less waiting >> (there is something similar via pattern matching, though). Sorry for coming back to this question. I've just looked again on the file count and I see 180.000 files. Even if the clicks don't take 5s, I don't want to go through all files. How is FOSSology designed to assign licenses to multiple files at once? If I know the main license of a software package (a folder in my whole-distro upload), how can I assign this license to this folder and mark it as cleared? Bulk scanning only finds files with appropriate license headers. If these are missing, is there an alternative to manually selecting all affected/selected files? How to handle the special license "Dual-license"? How can I choose a license for many files at once? Thanks in advance and sorry for this avalance of questions, Hans-Joachim -----Ursprüngliche Nachricht----- Von: Michael C. Jaeger <[email protected]> Gesendet: Donnerstag, 5. September 2019 16:11 An: Daniels, Hans-Joachim <[email protected]> Cc: [email protected] Betreff: Re: [FOSSology] FOSSology for custom Linux distributions? Hello, but you need to change your postgresql setup. The main thing that you need to keep in mind is that postgresql comes with settings (after installation via apt or what ever package manager) that are good for machines with 512MB of RAM or so. Larger packages (more than 10k files) will work "OK", but ... For your Linux Distro I would plan to use a machine with 4Gb or 8Gb or RAM (actually, 300MB source code is not the main issue as it is the number of folders and files, but mostly folders, because walking through the directory three is insanely intensive when being mapped to the relational database tables of FOSSology) So, in a nutshell the short recommendation is to adjust your postgresql memory settings. Further tipp is to read: https://eur01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Ffossology%2Ffossology%2Fwiki%2FConfiguration-and-Tuning&data=02%7C01%7Cmichael.c.jaeger%40siemens.com%7C21d1a924011a48e50b8a08d732b00153%7C38ae3bcd95794fd4addab42e1495d55a%7C1%7C0%7C637033603848551013&sdata=nGekij0mhnuRLB9OBbt9pD%2FACpM9y%2FZzUUYzEQzCRb0%3D&reserved=0 Further tipp is to read on how to setup your postgresql for performance: https://eur01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdba.stackexchange.com%2Fquestions%2F27893%2Fincreasing-work-mem-and-shared-buffers-on-postgres-9-2-significantly-slows-down&data=02%7C01%7Cmichael.c.jaeger%40siemens.com%7C21d1a924011a48e50b8a08d732b00153%7C38ae3bcd95794fd4addab42e1495d55a%7C1%7C0%7C637033603848551013&sdata=QJKVH6%2BCUizZ9lOhBjtMbfaI%2F94F6bWeluxS6aj%2BDb0%3D&reserved=0 or use something like: https://eur01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fpgtune.leopard.in.ua%2F%23%2F&data=02%7C01%7Cmichael.c.jaeger%40siemens.com%7C21d1a924011a48e50b8a08d732b00153%7C38ae3bcd95794fd4addab42e1495d55a%7C1%7C0%7C637033603848551013&sdata=HDin4dgIdXd38u4uEzhHemogReWlInG2ws7MZoY9Pps%3D&reserved=0 If you do not feel familiar with what I have written, please feed back and we could maybe sort out a way how to help you. Kind regards, Michael > On 2. Sep 2019, at 16:22, Daniels, Hans-Joachim <[email protected]> wrote: > > Hello, > is it possible to use FOSSology on the level of a complete (custom) Linux distribution? > > Uploading the source code as one .tar.gz with ~300MB was possible, but the FOSSology UI was quite slow (seconds per click) while browsing this upload. > In addition, I couldn’t find a way to select multiple files at once to assign licenses with fewer clicks and therefore less waiting (there is something similar via pattern matching, though). > > Is FOSSology meant for the use case of a complete distro or am I abusing it? > Or could I use FOSSology in a smarter way to work around the experienced slowness? > > Thanks in advance, > Hans-Joachim Daniels > Turck Electronics GmbH | Geschäftsführer, Managing Director: Hermann Schwagmann, Guido Frohnhaus | Sitz, Registered Office: Detmold | Registergericht, Register Court: Amtsgericht Lemgo HRB 4921 > > > Wichtiger Hinweis: Diese E-Mail enthält Betriebs- oder Geschäftsgeheimnisse, rechtlich geschützte oder sonstige vertrauliche Informationen und ist ausschließlich für den Empfänger bestimmt. Sollten Sie diese E-Mail irrtümlich erhalten haben, ist Ihnen eine Kenntnisnahme des Inhalts, eine Vervielfältigung, Weitergabe oder sonstige Nutzung des Inhalts der E-Mail ausdrücklich untersagt. Bitte benachrichtigen Sie sofort den Absender und vernichten Sie die empfangene E-Mail. > > > Important Note: This e-mail may contain trade or business secrets, privileged, undisclosed or otherwise confidential information and is only intended for its addresses. If you have received this e-mail in error, you are hereby notified that any review, copying, distribution or any use of the content hereof is strictly prohibited. Please inform the sender immediately and destroy the received e-mail. > > ________________________________ Turck Electronics GmbH | Geschäftsführer, Managing Director: Hermann Schwagmann | Sitz, Registered Office: Detmold | Registergericht, Register Court: Amtsgericht Lemgo HRB 4921 ________________________________ -=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#3299): https://lists.fossology.org/g/fossology/message/3299 Mute This Topic: https://lists.fossology.org/mt/33152999/21656 Group Owner: [email protected] Unsubscribe: https://lists.fossology.org/g/fossology/unsub [[email protected]] -=-=-=-=-=-=-=-=-=-=-=-
