Jon, Inline.
> -----Original Message----- > From: Jon A. Cruz [mailto:jonc at osg.samsung.com] > Sent: Monday, July 20, 2015 10:28 AM > To: Lankswert, Patrick; yh_.joo at samsung.com; Zhang, Caiwen; iotivity- > dev at lists.iotivity.org > Subject: Re: [dev] "expat" library download problem > > On 07/20/2015 07:18 AM, Lankswert, Patrick wrote: > > Jon, > > > > We were talking about a docker environment for the build machines what > would pull all the necessary dependencies. > > Well... there are two sets of conflicting needs for the builds. One is that > the > incremental builds should be as fast as possible, so if all things needing to > be > downloaded are already present somewhere on the build system then we have > the quickest turnaround. > > The other is that we want to validate the build system itself (especially > since with > SCons we have build our own build system from a toolkit). For this we would > want each build to start 'clean' and download all external sources needed for > the build. This will obviously take longer to run. Agreed, but a clean build does not necessitate a new download, right? I am NOT in favor of downloading every time or downloading items that are not needed. I also find it distasteful that we would require a developer to download Android dependencies when they only want to build linux. > > Regarding cached sources; it depends in what you mean by cached sources. If > you are talking about dependencies that pull from HEAD of their respective > repos, I would like to avoid that. I think that we want to be declarative on > our > dependencies. By this, I mean that we only bump dependencies version > deliberately. I would be very unhappy if our builds break because of some > dependent library bugs. Or, worse, some device developer, pulls a version of a > dependency that has a security flaw that the community has not validated yet. > That said, it still can happen, but we should be able to tell people how to > build a > best known good. > > > > Mostly I'm speaking of anything that comes from somewhere other than our > own IoTivity repo. > > For Linux developers this more often than not means using their distro's > package > manager to pull in the needed *-dev packages. For Windows developers this > means manually downloading and staging raw sources themselves (often from > tarballs and other packaged sources). > > As we've seen in this case, over time the specific URL to fetch a version of > a file > can and will change. This should not be a blocker for building IoTivity. The > files > might move, or might be retracted by their publisher to be replaced by > different > versions, etc. Sure. A URL change is a project affecting event. Documentation needs to updated or the next developer to download our SDK may be lost finding the more obscure dependencies. In addition, rev'ing the version triggers a QA cycle since the build machines can only compile and run unit tests. It does not run system tests which require network access. Regarding IT department restrictions; I am interested in whether this is a common issue or a corner case. There are several build systems that are popular that will have this exact same problem including Maven, Nuget, Artifactory, etc. I agree that a good workaround needs to exist. I am open to suggestions. All that I am asking for is a declarative/reproducible build system where any given commit can reproduce the same binaries every time or die trying. And when it dies, it is clear about what is missing and what needs to be done to fix it. Pat > > > > >> -----Original Message----- > >> From: iotivity-dev-bounces at lists.iotivity.org [mailto:iotivity-dev- > >> bounces at lists.iotivity.org] On Behalf Of Jon A. Cruz > >> Sent: Monday, July 20, 2015 10:07 AM > >> To: yh_.joo at samsung.com; Zhang, Caiwen; > >> iotivity-dev at lists.iotivity.org > >> Subject: Re: [dev] "expat" library download problem > >> > >> Hi, > >> > >> I just wanted to point out that this is an occurrence of a potential > >> problem I raised on IRC just this past week. > >> > >> Many CM departments will have policies in place that avoid > >> downloading during builds, and we should be sure that it is easy to avoid > such. > >> > >> As a second point, our incremental builds might be running from > >> locally cached sources, so we should look into making sure there is > >> perhaps a daily that does full downloads so that we can be sure to > >> detect broken/stale links as soon as they arise. > >> > >> Thanks! > >> > >> On 07/17/2015 08:18 PM, ??? wrote: > >>> * > >>> > >>> * > >>> > >>> Hi, Caiwen > >>> > >>> I fixed it. > >>> > >>> I commit to the gerrit(https://gerrit.iotivity.org/gerrit/#/c/1727/) > >>> > >>> After the check, if you have any problem, please reply me. > >>> > >>> Thanks > >>> > >>> Best Regards > >>> > >>> Younghyun Joo > >>> > >>> */- SWC IoT Solution Lab. /**??? ?? ??* > >>> > >>> */#??: ???? ??./* > >>> > >>> ** > >>> > >>> -------------------------------------------------------------------- > >>> -- > >>> ---------- > >>> ** > >>> > >>> *Younghyun, Joo****|****SW Assist Engineer * > >>> > >>> *IoT(Internet of Things) Solution Lab.,* > >>> > >>> *Web & Convergence Team, **SoftWare Center,* > >>> > >>> ***SAMSUNG ELECTRONICS CO., LTD.*** > >>> > >>> * M**o**bi**le******+82.10.3794.8718* > >>> > >>> * E_mail********yh_.joo at samsung.com* > >>> <mailto:yh_.joo at samsung.com><mailto:yh_.joo at samsung.com> > >>> > >>> * > >>> > >>> ** > >>> -------------------------------------------------------------------- > >>> -- > >>> ---------- > >>> * > >>> > >>> ------- *Original Message* ------- > >>> > >>> *Sender* : ???<yh_.joo at samsung.com> S3(??)/??/IoT Solution > >> Lab(S/W??) > >>> /???? > >>> > >>> *Date* : 2015-07-18 11:55 (GMT+09:00) > >>> > >>> *Title* : "expat" library download problem > >>> > >>> * > >>> > >>> * > >>> > >>> Hi, Caiwen > >>> > >>> I have a problem with downloading expat library. > >>> > >>> A few days ago, when I tried to scons build for Android target, I > >>> could easily build. > >>> > >>> But now, I can't. On the downloading process, it cannot download the > >>> expat.tar.gz file > >>> > >>> I tried to download on the website directly. I cannot download, I > >>> think that download link is changed > >>> > >>> (Oiginal link on SConscript: > >>> http://sourceforge.net/projects/expat/files/expat/2.1.0/expat-2.1.0. > >>> ta > >>> r.gz/download > >>> > >>> Possible link: > >>> http://downloads.sourceforge.net/project/expat/expat/2.1.0/expat-2.1 > >>> .0 > >>> .tar.gz) > >>> > >>> Could you change the link on SConscript file? > >>> > >>> (I tried to change the link by myself, but download errors are still > >>> occurred. > >>> > >>> I also checked the "env.Download" method (defined in > >>> build_common/external_libs.scons) and extlibs/expat/SConscript file, > >>> I cannot find the reason.) > >>> > >>> I'm looking forward to your commit and reply. > >>> > >>> Do you have any question or detail explanation, feel free to ask me. > >>> > >>> Thanks > >>> > >>> Best Regards > >>> > >>> Younghyun Joo > >>> > >>> ** > >>> > >>> -------------------------------------------------------------------- > >>> -- > >>> ---------- > >>> ** > >>> > >>> *Younghyun, Joo****|****SW Assist Engineer * > >>> > >>> *IoT(Internet of Things) Solution Lab.,* > >>> > >>> *Web & Convergence Team, **SoftWare Center,* > >>> > >>> ***SAMSUNG ELECTRONICS CO., LTD.*** > >>> > >>> * M**o**bi**le******+82.10.3794.8718* > >>> > >>> * E_mail********yh_.joo at samsung.com* > >>> <mailto:yh_.joo at samsung.com><mailto:yh_.joo at samsung.com> > >>> > >>> * > >>> > >>> ** > >>> -------------------------------------------------------------------- > >>> -- > >>> ---------- > >>> * > >>> > >>> > >>> > >>> _______________________________________________ > >>> iotivity-dev mailing list > >>> iotivity-dev at lists.iotivity.org > >>> https://lists.iotivity.org/mailman/listinfo/iotivity-dev > >>> > >> > >> -- > >> Jon A. Cruz - Senior Open Source Developer Samsung Open Source Group > >> jonc at osg.samsung.com > _______________________________________________ > >> iotivity-dev mailing list > >> iotivity-dev at lists.iotivity.org > >> https://lists.iotivity.org/mailman/listinfo/iotivity-dev > > _______________________________________________ > > iotivity-dev mailing list > > iotivity-dev at lists.iotivity.org > > https://lists.iotivity.org/mailman/listinfo/iotivity-dev > > > > -- > Jon A. Cruz - Senior Open Source Developer Samsung Open Source Group > jonc at osg.samsung.com
