[OE-core] Improve npm support to run build scripts

Hi Jean-Marie and Richard, I must improve the npm support for our use cases but need some fundamental decisions to proceed. I need to build express and angular applications from git repositories. I have the following changes in my pipeline until now: - Support npm packages with missing execut

Re: [OE-core] Improve npm support to run build scripts

Hi Stefan, Thanks for bring this up, I've been wondering on the status of our npm support. On Tue, 2021-10-05 at 12:04 +0200, Stefan Herbrechtsmeier wrote: > I must improve the npm support for our use cases but need some > fundamental decisions to proceed. I need to build express and angular >

Re: [OE-core] Improve npm support to run build scripts

Hi Richard, Am 05.10.2021 um 13:09 schrieb Richard Purdie: Thanks for bring this up, I've been wondering on the status of our npm support. Do you know any npm users? On Tue, 2021-10-05 at 12:04 +0200, Stefan Herbrechtsmeier wrote: I must improve the npm support for our use cases but need so

Re: [OE-core] Improve npm support to run build scripts

I think the supposed workflow with the new npm.class was to use 'devtool create' which would run some npm magic to to create a single recipe that has all of the npm-fetched dependencies inside SRC_URI. Have you tried that? A layer with thousands of recipes seems totally intractable. Alex On Tue,

Re: [OE-core] Improve npm support to run build scripts

'devtool add' of course. Test case is in meta/lib/oeqa/selftest/cases/devtool.py Alex On Tue, 5 Oct 2021 at 15:10, Alexander Kanavin via lists.openembedded.org wrote: > I think the supposed workflow with the new npm.class was to use 'devtool > create' which would run some npm magic to to create

Re: [OE-core] Improve npm support to run build scripts

Hi Alex, Am 05.10.2021 um 15:10 schrieb Alexander Kanavin: I think the supposed workflow with the new npm.class was to use 'devtool create' which would run some npm magic to to create a single recipe that has all of the npm-fetched dependencies inside SRC_URI. There is no magic inside npm. It

Re: [OE-core] Improve npm support to run build scripts

Hi Stefan, On 05/10/2021 15:48, Stefan Herbrechtsmeier wrote: Is a layer with more more than 1000 recipes thinkable? Did you have a look at this[1]? It says: "For instance I currently am using around 10 NPM-packages, those culminated into (currently) 937 recipes that are required to build

Re: [OE-core] Improve npm support to run build scripts

On Tue, 5 Oct 2021 at 19:44, Stefan Herbrechtsmeier < stefan.herbrechtsmeier-...@weidmueller.com> wrote: > > > A layer with thousands of recipes seems totally intractable. > > What is your concern? The high number of dependencies or to handle it > via OE? > Generating recipes with a tool means th

Re: [OE-core] Improve npm support to run build scripts

On 05.10.21 21:17, Alexander Kanavin wrote: On Tue, 5 Oct 2021 at 19:44, Stefan Herbrechtsmeier > wrote: > A layer with thousands of recipes seems totally intractable. What is your concern? The high number of dependencies or to han

Re: [OE-core] Improve npm support to run build scripts

On Tue, Oct 5, 2021 at 12:29 PM Konrad Weihmann wrote: > > While personally I think in the long run, every npm dependency has to be > provided as a recipe of its own (even I know the costs of that pretty > well)... esp when CVE checking and basic packaging hygiene should be > enforced. > Emphati

Re: [OE-core] Improve npm support to run build scripts

Hi Robert, Am 05.10.2021 um 20:18 schrieb Robert Berger: On 05/10/2021 15:48, Stefan Herbrechtsmeier wrote: Is a layer with more more than 1000 recipes thinkable? Did you have a look at this[1]? It says: "For instance I currently am using around 10 NPM-packages, those culminated into (curr

Re: [OE-core] Improve npm support to run build scripts

Hi Alex, Am 05.10.2021 um 21:17 schrieb Alexander Kanavin: On Tue, 5 Oct 2021 at 19:44, Stefan Herbrechtsmeier > wrote: > A layer with thousands of recipes seems totally intractable. What is your concern? The high number of dependen

Re: [OE-core] Improve npm support to run build scripts

Hi Konrad, Am 05.10.2021 um 21:29 schrieb Konrad Weihmann: On 05.10.21 21:17, Alexander Kanavin wrote: On Tue, 5 Oct 2021 at 19:44, Stefan Herbrechtsmeier > wrote: > A layer with thousands of recipes seems totally intractable.     Wh

Re: [OE-core] Improve npm support to run build scripts

On 06.10.21 11:18, Stefan Herbrechtsmeier wrote: Hi Konrad, Am 05.10.2021 um 21:29 schrieb Konrad Weihmann: On 05.10.21 21:17, Alexander Kanavin wrote: On Tue, 5 Oct 2021 at 19:44, Stefan Herbrechtsmeier > wrote: > A layer with tho

Re: [OE-core] Improve npm support to run build scripts

The OE landscape is littered with unmaintained or barely maintained layers. By the looks of things, no one wants to maintain this proposed meta-nodejs layer either, which involves thousands of recipes, (so far) non-existent tooling to create and update them in scalable ways, and rigorous testing. O

Re: [OE-core] Improve npm support to run build scripts

On Wed, Oct 6, 2021 at 2:48 AM Alexander Kanavin wrote: > The OE landscape is littered with unmaintained or barely maintained > layers. By the looks of things, no one wants to maintain this proposed > meta-nodejs layer either, which involves thousands of recipes, (so far) > non-existent tooling t

Re: [OE-core] Improve npm support to run build scripts

Hi Tim, Am 08.10.2021 um 07:27 schrieb Tim Orling: We have discussed the severe impact on parsing time with 100k recipes. I personally worked on a node.js project with that many dependencies (but not an OE/Yocto deployment). Parsing time is already a pain point for 1000s of recipes. How do y

Re: [OE-core] Improve npm support to run build scripts

Hi, Am 06.10.2021 um 11:47 schrieb Alexander Kanavin: The OE landscape is littered with unmaintained or barely maintained layers. By the looks of things, no one wants to maintain this proposed meta-nodejs layer either, which involves thousands of recipes, (so far) non-existent tooling to creat

Re: [OE-core] Improve npm support to run build scripts

On Tue, 19 Oct 2021 at 14:52, Stefan Herbrechtsmeier < stefan.herbrechtsmeier-...@weidmueller.com> wrote: > How should we run build scripts which need native npm packages and how > should we handle licenses of build and runtime packages? > > A simplified node.js flow looks like the following > > c