> On 1 Nov 2019, at 12:14, Nitin Saxena <nsax...@marvell.com> wrote: > > Hi Damjan, > >>> I don’t understand why you cannot specify your preferred set of args >>> directly in the buildroot makefile... > We can do that. I thought (1) and (2) is the recommended way of cross > compiling VPP. So if I understand correctly all Makefiles in > build-data/platforms/ are intended for native compilation and not for cross
There ere 2 different types of cross-compilation in my view: 1. Platform images - where you build everything from scratch, toolchain, kernel, glibc, busybox - that is the case for which 2) was used in the past, and it can be still used but somebody will need to create and maintain bunch of build-data/packages/*.mk files and those days it is not feasible that such thing will happen, as there are few well maintained open source projects which provide same functionality like buildroot, yocto, openwrt ... 2. Distro packages - where vpp is crosscompiled, linked against distro provided shared libraries and packaged for that distro. That is something 2) cannot do properly, and that is the reason why i was looking for alternative solution with docker. So in my view 2) provides maintenance overhead but not lot of value for our use cases, so we should replace it with something much simpler to maintain. > > Thanks, > Nitin > >> -----Original Message----- >> From: Damjan Marion <dmar...@me.com> >> Sent: Friday, November 1, 2019 4:10 PM >> To: Nitin Saxena <nsax...@marvell.com> >> Cc: vpp-dev@lists.fd.io >> Subject: Re: [EXT] [vpp-dev] cross-compilation support >> >> >> >>>> On 1 Nov 2019, at 09:57, Nitin Saxena <nsax...@marvell.com> wrote: >>> >>> Hi Damjan, >>> >>>>> My comment bellow is that only 1) is really needed to build VPP, >>>>> people can decide to use own build system like buildroot or yocto >>>>> and invoke cmake directly, and completely ignore 2) and 3 >>> Correct me if I am wrong, purpose of build-data/platforms/*.mk (except >> vpp.mk) can be to configure ebuild for cross compilation. make build[- >> release] PLATFORM="aarch64..." was recommended way for cross >> compilation in VPP? If yes, is it OK to use 1) and 2) for cross compilation? >> >> Personally i would not recommend to use 2) for cross-compilation because of >> reasons i explained in my previous emails. >> >>> >>> We internally uses (1) and (2) for our buildroot based cross compilation for >> octeontx. Hence I asked for the capability to pass vpp_cmake_args from >> build-data/platforms/octeontx.mk because I found it as a cleaner approach. >> Comments? >> >> I don't see a point of doing that. you just add another moving part to your >> build system. >> I don’t understand why you cannot specify your preferred set of args directly >> in the buildroot makefile... >> >> >>> >>> Thanks, >>> Nitin >>> >>>> -----Original Message----- >>>> From: Damjan Marion <dmar...@me.com> >>>> Sent: Friday, November 1, 2019 1:34 AM >>>> To: Damjan Marion <dmar...@me.com> >>>> Cc: Nitin Saxena <nsax...@marvell.com>; vpp-dev@lists.fd.io >>>> Subject: Re: [EXT] [vpp-dev] cross-compilation support >>>> >>>> >>>> Let me clarify a bit more, as i can see that this still may be confusing: >>>> >>>> 1) VPP is using cmake to build binaries and packages, all cmake >>>> related stuff is in src/. >>>> >>>> 2) there is build-root/Makefile and files in build-data/* which are >>>> part of old build system called ebuild >>>> - ebuild is very complex set of make scripts which have similar >>>> functionality like buildroot, it was able to build kernel, toolchain >>>> , userspace tools and libraries >>>> - today we don't use much of ebuild, it is just used to run VPP cmake >>>> prioject in the right directory with he right set of command line >>>> arguments >>>> >>>> 3) Other Makefiles >>>> - top level makefile >>>> - external deps makefiles in build/external/ >>>> >>>> My comment bellow is that only 1) is really needed to build VPP, >>>> people can decide to use own build system like buildroot or yocto and >>>> invoke cmake directly, and completely ignore 2) and 3). In such case >>>> selected build system also needs to take care for dependencies like DPDK. >>>> >>>> ebuild 2) have excellent cross compilation support for building >>>> target images when those images contain everything from kernel and >>>> libraries to vpp but it is not appropriate tool for creating >>>> distribution packages, i.e. creating Centos ARM rpms on Ubuntu x86 >>>> machine. That is the reason why i tried to see if we can use docker >>>> instead to be able to build cross-arch, cross-distro or cross- >>>> distro-version >> (or all 3 together) packages. >>>> While my patch is incomplete, it looks to me like this approach will work. >>>> >>>> My patch does native compilation only if TARGET_QUAD is equal to >>>> HOST_QUAD, where QUAD is: >>>> - distro name (ubuntu, centos) >>>> - distro version (18.04, 7.3) >>>> - arch (x86_64, aarch64, ...) >>>> - platform (generic, thunderx, ….) >>>> >>>> it also support multiple build_types (release, debug, gcov, … ) >>>> >>>> At this point it is just early draft, but it shows some basic >>>> mechanics used to produce both native and cross packages. >>>> >>>> >>>>> On 31 Oct 2019, at 20:32, Damjan Marion via Lists.Fd.Io >>>> <dmarion=me....@lists.fd.io> wrote: >>>>> >>>>> I have similar scheme on my mind, where you can have platform >>>>> specific >>>> mk files loaded…. >>>>> >>>>>> On 31 Oct 2019, at 20:23, Nitin Saxena <nsax...@marvell.com> wrote: >>>>>> >>>>>> Hi, >>>>>> >>>>>>>> cmake /path/to/vpp/src [your favorite xcompile args] cmake —build >> . >>>>>> Instead of having a shell script to pass cmake commands, I really >>>>>> liked the >>>> idea of passing vpp_cmake_args from build-data/platforms/*.mk >>>> (https://urldefense.proofpoint.com/v2/url?u=https-3A__gerrit.fd.io_r_ >>>> - >>>> 23_c_vpp_-2B_21035_23_build-2Ddata_platforms_native.mk- >>>> >> 4042&d=DwIFaQ&c=nKjWec2b6R0mOyPaz7xtfQ&r=S4H7jibYAtA5YOvfL3IkGd >>>> uCfk9LbZMPOAecQGDzWV0&m=IxbLPjpkpGrr4_eh99mqx2_EhWrxhKwu- >>>> 8jEs5kosq8&s=izhC0z_k8Jz2hBw10il9EQpbYMyaLJ-d_7UczT_Ip8I&e= ). Any >>>> comment of taking those changes? >>>>>> >>>>>> Thanks, >>>>>> Nitin >>>>>> >>>>>>> -----Original Message----- >>>>>>> From: vpp-dev@lists.fd.io <vpp-dev@lists.fd.io> On Behalf Of >>>>>>> Damjan Marion via Lists.Fd.Io >>>>>>> Sent: Friday, November 1, 2019 12:15 AM >>>>>>> To: Christian Hopps <cho...@chopps.org> >>>>>>> Cc: vpp-dev@lists.fd.io >>>>>>> Subject: [EXT] Re: [vpp-dev] cross-compilation support >>>>>>> >>>>>>> External Email >>>>>>> >>>>>>> ------------------------------------------------------------------ >>>>>>> -- >>>>>>> -- >>>>>>> >>>>>>> Nobody requires you to use docker, you are free to pass right >>>>>>> arguments straight to the cmake. >>>>>>> >>>>>>> All the stuff in build-data, build-root, build/ is optional, and >>>>>>> it is there to help developers to stage workspace and create >>>>>>> packages but VPP can be built as simple as: >>>>>>> >>>>>>> mkdir build >>>>>>> cd build >>>>>>> cmake /path/to/vpp/src [your favorite xcompile args] cmake —build . >>>>>>> >>>>>>> >>>>>>> >>>>>>>> On 31 Oct 2019, at 19:39, Christian Hopps <cho...@chopps.org> >>>> wrote: >>>>>>>> >>>>>>>> I mean to call out the use of docker/qemu. In order to allow for >>>>>>>> this the >>>>>>> user has to have extra privileges. >>>>>>>> >>>>>>>> As I mentioned, locally we use docker for building, I like it, >>>>>>>> it's a nice tool; >>>>>>> however, my personal opinion is that it seems wrong to require >>>>>>> docker and/or qemu for compiling an open source project. >>>>>>>> >>>>>>>> Important in holding this opinion is that it's seems possible to >>>>>>>> make this >>>>>>> work w/o docker/qemu/root, I think someone just has to find the >>>>>>> time to make an acceptable to the project working patch. >>>>>>>> >>>>>>>> I asked internally and it seems that our changes to support >>>>>>>> x-compile do >>>>>>> not go as far as producing debian/ubuntu packages, so they aren't >>>>>>> ready for upstreaming, unfortunately. >>>>>>>> >>>>>>>> Thanks, >>>>>>>> Chris. >>>>>>>> >>>>>>>>> On Oct 31, 2019, at 2:23 PM, Damjan Marion <dmar...@me.com> >>>> wrote: >>>>>>>>> >>>>>>>>> >>>>>>>>> That is just copy paste from Ben’s command line. >>>>>>>>> >>>>>>>>> As. i wrote, this is just about presenting the concept... >>>>>>>>> >>>>>>>>>> On 31 Oct 2019, at 18:39, Christian Hopps <cho...@chopps.org> >>>> wrote: >>>>>>>>>> >>>>>>>>>> Requiring root privileges for building software is pretty >>>>>>>>>> atypical and >>>>>>> limiting, even for x-compiling. >>>>>>>>>> >>>>>>>>>> Thanks, >>>>>>>>>> Chris. >>>>>>>>>> >>>>>>>>>>> On Oct 31, 2019, at 12:45 PM, Damjan Marion via Lists.Fd.Io >>>>>>> <dmarion=me....@lists.fd.io> wrote: >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> So what people think about following approach for cross- >>>> compilation: >>>>>>>>>>> >>>>>>>>>>> Patch: >>>>>>>>>>> https://urldefense.proofpoint.com/v2/url?u=https-3A__gerrit.fd >>>>>>>>>>> .i >>>>>>>>>>> o_r >>>>>>>>>>> _c_vpp_- >>>>>>> >> 2B_23153&d=DwIFaQ&c=nKjWec2b6R0mOyPaz7xtfQ&r=S4H7jibYAtA5YO >>>>>>>>>>> >>>>>>> >>>> >> vfL3IkGduCfk9LbZMPOAecQGDzWV0&m=G81bDw8Lj77hbqAq7cdeDRXZev- >>>>>>> ZVMwh0n_ >>>>>>>>>>> oePUFrlQ&s=Lk5OD0CVQuGPdj-h0TfK- >>>> m8NMJj0Zci0EhjBcQxYn2E&e= >>>>>>>>>>> >>>>>>>>>>> At the moment this is just to show idea, so it works only for >>>>>>>>>>> x86-to-x86 and between ubuntu versions only but it can be >>>>>>>>>>> easily >>>>>>> extended to scenarios like build vpp packages for AArch64 centos7 >>>>>>> on ubuntu x86 host. >>>>>>>>>>> >>>>>>>>>>> export CROSS_DISTRO_NAME=ubuntu exprot >> CROSS_DISTRO_VER=18.04 >>>>>>>>>>> export CROSS_ARCH=x86_64 export CROSS_TARGET=release >>>>>>>>>>> >>>>>>>>>>> $ make cross-env-init >>>>>>>>>>> >>>>>>>>>>> this is executed once, it creates docker container named >>>>>>>>>>> "vpp-dev-env- >>>>>>> ubuntu-18.04-x86_64”, install all dependencies including DPDK and >>>>>>> other libs” >>>>>>>>>>> >>>>>>>>>>> $ make cross-env-update >>>>>>>>>>> >>>>>>>>>>> updates cross-env to latest packages and ext-deps >>>>>>>>>>> >>>>>>>>>>> $ make cross-shell >>>>>>>>>>> >>>>>>>>>>> starts shell inside cross-env >>>>>>>>>>> >>>>>>>>>>> $ make cross-package >>>>>>>>>>> >>>>>>>>>>> builds VPP and creates packages: >>>>>>>>>>> >>>>>>>>>>> ls -la build/ubuntu-18.04-x86_64-release total 11716 >>>>>>>>>>> drwxr-xr-x 3 root root 4096 Oct 31 17:30 . >>>>>>>>>>> drwxrwxr-x 4 damarion damarion 4096 Oct 31 17:36 .. >>>>>>>>>>> drwxr-xr-x 22 root root 4096 Oct 31 17:30 build >>>>>>>>>>> -rw-r--r-- 1 root root 190124 Oct 31 17:30 >>>>>>>>>>> libvppinfra_20.01- >>>>>>> rc0~555-g7f980bcfe_amd64.deb >>>>>>>>>>> -rw-r--r-- 1 root root 145056 Oct 31 17:30 libvppinfra- >>>> dev_20.01- >>>>>>> rc0~555-g7f980bcfe_amd64.deb >>>>>>>>>>> -rw-r--r-- 1 root root 23140 Oct 31 17:30 python3-vpp- >>>> api_20.01- >>>>>>> rc0~555-g7f980bcfe_amd64.deb >>>>>>>>>>> -rw-r--r-- 1 root root 8815 Oct 31 17:30 >>>>>>>>>>> vpp_20.01-rc0~555- >>>>>>> g7f980bcfe_amd64.buildinfo >>>>>>>>>>> -rw-r--r-- 1 root root 4147 Oct 31 17:30 >>>>>>>>>>> vpp_20.01-rc0~555- >>>>>>> g7f980bcfe_amd64.changes >>>>>>>>>>> -rw-r--r-- 1 root root 3674024 Oct 31 17:30 vpp_20.01- >> rc0~555- >>>>>>> g7f980bcfe_amd64.deb >>>>>>>>>>> -rw-r--r-- 1 root root 23104 Oct 31 17:30 vpp-api- >>>> python_20.01- >>>>>>> rc0~555-g7f980bcfe_amd64.deb >>>>>>>>>>> -rw-r--r-- 1 root root 719712 Oct 31 17:30 vpp-dbg_20.01- >>>> rc0~555- >>>>>>> g7f980bcfe_amd64.deb >>>>>>>>>>> -rw-r--r-- 1 root root 915744 Oct 31 17:30 vpp-dev_20.01- >>>> rc0~555- >>>>>>> g7f980bcfe_amd64.deb >>>>>>>>>>> -rw-r--r-- 1 root root 3113820 Oct 31 17:30 vpp-plugin- >>>> core_20.01- >>>>>>> rc0~555-g7f980bcfe_amd64.deb >>>>>>>>>>> -rw-r--r-- 1 root root 3144784 Oct 31 17:30 vpp-plugin- >>>> dpdk_20.01- >>>>>>> rc0~555-g7f980bcfe_amd64.deb >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> -=-=-=-=-=-=-=-=-=-=-=- >>>>>>>>>>> Links: You receive all messages sent to this group. >>>>>>>>>>> >>>>>>>>>>> View/Reply Online (#14428): >>>>>>>>>>> https://urldefense.proofpoint.com/v2/url?u=https-3A__lists.fd. >>>>>>>>>>> io >>>>>>>>>>> _g_ >>>>>>>>>>> vpp- >>>>>>> >>>> >> 2Ddev_message_14428&d=DwIFaQ&c=nKjWec2b6R0mOyPaz7xtfQ&r=S4H7ji >>>>>>> b >>>>>>>>>>> >>>>>>> >>>> >> YAtA5YOvfL3IkGduCfk9LbZMPOAecQGDzWV0&m=G81bDw8Lj77hbqAq7cdeD >>>>>>> RXZev-Z >>>>>>>>>>> VMwh0n_oePUFrlQ&s=iBMmIxh4KnS1Ig6WteL2- >>>>>>> 14ET0OV4oviKkohF5pvnKI&e= >>>>>>>>>>> Mute This Topic: >>>>>>>>>>> https://urldefense.proofpoint.com/v2/url?u=https-3A__lists.fd. >>>>>>>>>>> io >>>>>>>>>>> _mt >>>>>>>>>>> >>>>>>> >>>> >> _40199795_1826170&d=DwIFaQ&c=nKjWec2b6R0mOyPaz7xtfQ&r=S4H7jibY >>>>>>> AtA5Y >>>>>>>>>>> >>>>>>> >>>> >> OvfL3IkGduCfk9LbZMPOAecQGDzWV0&m=G81bDw8Lj77hbqAq7cdeDRXZev- >>>>>>> ZVMwh0n >>>>>>>>>>> _oePUFrlQ&s=MfbIY3- >>>> EEVgV9eXT0IgUFliXj2yF4LQ5C8SDZWKqEIA&e= >>>>>>>>>>> Group Owner: vpp-dev+ow...@lists.fd.io >>>>>>>>>>> Unsubscribe: https://urldefense.proofpoint.com/v2/url?u=https- >>>>>>> 3A__lists.fd.io_g_vpp- >>>>>>> >>>> >> 2Ddev_unsub&d=DwIFaQ&c=nKjWec2b6R0mOyPaz7xtfQ&r=S4H7jibYAtA5YO >>>>>>> >>>> >> vfL3IkGduCfk9LbZMPOAecQGDzWV0&m=G81bDw8Lj77hbqAq7cdeDRXZev- >>>>>>> ZVMwh0n_oePUFrlQ&s=WBlsVcHNJGCJ9xYyS9QwicssF0GaRcoS8m- >>>>>>> 2KINBAQ0&e= [cho...@chopps.org] >>>>>>>>>>> -=-=-=-=-=-=-=-=-=-=-=- >>>>>>>>>> >>>>>>>>> >>>>>>>> >>>>>>>> -=-=-=-=-=-=-=-=-=-=-=- >>>>>>>> Links: You receive all messages sent to this group. >>>>>>>> >>>>>>>> View/Reply Online (#14434): >>>>>>>> https://urldefense.proofpoint.com/v2/url?u=https-3A__lists.fd.io_ >>>>>>>> g_ >>>>>>>> vpp >>>>>>>> - >>>>>>> >>>> >> 2Ddev_message_14434&d=DwIFaQ&c=nKjWec2b6R0mOyPaz7xtfQ&r=S4H7ji >>>>>>> bYAtA5Y >>>>>>>> >>>>>>> >>>> >> OvfL3IkGduCfk9LbZMPOAecQGDzWV0&m=G81bDw8Lj77hbqAq7cdeDRXZev- >>>>>>> ZVMwh0n_oe >>>>>>>> PUFrlQ&s=oJ64M8FgFtN93xTTErLxt85eClgNdxMohhu2Fk8vCuU&e= >>>>>>>> Mute This Topic: >>>>>>>> https://urldefense.proofpoint.com/v2/url?u=https-3A__lists.fd.io_ >>>>>>>> mt >>>>>>>> _40 >>>>>>>> >>>>>>> >>>> >> 199795_675642&d=DwIFaQ&c=nKjWec2b6R0mOyPaz7xtfQ&r=S4H7jibYAtA5Y >>>>>>> OvfL3Ik >>>>>>>> GduCfk9LbZMPOAecQGDzWV0&m=G81bDw8Lj77hbqAq7cdeDRXZev- >>>>>>> ZVMwh0n_oePUFrlQ& >>>>>>>> s=Yrx16m5FpMJvTAPtftp7qv-ZWXW8XvQxTpFyAblkNJc&e= >>>>>>>> Group Owner: vpp-dev+ow...@lists.fd.io >>>>>>>> Unsubscribe: https://urldefense.proofpoint.com/v2/url?u=https- >>>>>>> 3A__lists.fd.io_g_vpp- >>>>>>> >>>> >> 2Ddev_unsub&d=DwIFaQ&c=nKjWec2b6R0mOyPaz7xtfQ&r=S4H7jibYAtA5YO >>>>>>> >>>> >> vfL3IkGduCfk9LbZMPOAecQGDzWV0&m=G81bDw8Lj77hbqAq7cdeDRXZev- >>>>>>> ZVMwh0n_oePUFrlQ&s=WBlsVcHNJGCJ9xYyS9QwicssF0GaRcoS8m- >>>>>>> 2KINBAQ0&e= [dmar...@me.com] >>>>>>>> -=-=-=-=-=-=-=-=-=-=-=- >>>>>> >>>>> >>>>> -=-=-=-=-=-=-=-=-=-=-=- >>>>> Links: You receive all messages sent to this group. >>>>> >>>>> View/Reply Online (#14440): >>>>> https://urldefense.proofpoint.com/v2/url?u=https-3A__lists.fd.io_g_v >>>>> pp >>>>> - >>>> >> 2Ddev_message_14440&d=DwIFaQ&c=nKjWec2b6R0mOyPaz7xtfQ&r=S4H7ji >>>> bYAtA5Y >>>>> >>>> >> OvfL3IkGduCfk9LbZMPOAecQGDzWV0&m=IxbLPjpkpGrr4_eh99mqx2_EhWrx >>>> hKwu-8jEs >>>>> 5kosq8&s=nQMb1nd7vWlPa5RMfQTrfOnx6nlTdk6xEhZNt_y0LWs&e= >>>>> Mute This Topic: >>>>> https://urldefense.proofpoint.com/v2/url?u=https-3A__lists.fd.io_mt_ >>>>> 40 >>>>> >>>> >> 237995_675642&d=DwIFaQ&c=nKjWec2b6R0mOyPaz7xtfQ&r=S4H7jibYAtA5Y >>>> OvfL3Ik >>>>> >>>> >> GduCfk9LbZMPOAecQGDzWV0&m=IxbLPjpkpGrr4_eh99mqx2_EhWrxhKwu- >>>> 8jEs5kosq8& >>>>> s=wHim_NCcM62y8QnfDDUTYAZ0DlXqbenRG2CiJrd4kkc&e= >>>>> Group Owner: vpp-dev+ow...@lists.fd.io >>>>> Unsubscribe: https://urldefense.proofpoint.com/v2/url?u=https- >>>> 3A__lists.fd.io_g_vpp- >>>> >> 2Ddev_unsub&d=DwIFaQ&c=nKjWec2b6R0mOyPaz7xtfQ&r=S4H7jibYAtA5YO >>>> >> vfL3IkGduCfk9LbZMPOAecQGDzWV0&m=IxbLPjpkpGrr4_eh99mqx2_EhWrxh >>>> Kwu-8jEs5kosq8&s=NBAc1_qNZrl4UC0j5UND8W0Bnui0uP8- >> jMvdsQtNpZE&e= >>>> [dmar...@me.com] >>>>> -=-=-=-=-=-=-=-=-=-=-=- >>> > > -=-=-=-=-=-=-=-=-=-=-=- > Links: You receive all messages sent to this group. > > View/Reply Online (#14460): https://lists.fd.io/g/vpp-dev/message/14460 > Mute This Topic: https://lists.fd.io/mt/40243741/675642 > Group Owner: vpp-dev+ow...@lists.fd.io > Unsubscribe: https://lists.fd.io/g/vpp-dev/unsub [dmar...@me.com] > -=-=-=-=-=-=-=-=-=-=-=-
-=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#14461): https://lists.fd.io/g/vpp-dev/message/14461 Mute This Topic: https://lists.fd.io/mt/40243741/21656 Group Owner: vpp-dev+ow...@lists.fd.io Unsubscribe: https://lists.fd.io/g/vpp-dev/unsub [arch...@mail-archive.com] -=-=-=-=-=-=-=-=-=-=-=-
