Re: [easybuild] Slurm/MPI error on importing tensorflow

2020-02-18 Thread Åke Sandgren
On 2/19/20 8:21 AM, Loris Bennett wrote: > OK, so you have the various PMIx versions installed both within *and* > separate from EB - that's the bit I was missing. It is obviously a > slightly clunky solution, but, as you say, not much maintenance needed > once it has been set up. I think this

Re: [easybuild] Obtain all the urls of the tarballs used by eb.

2020-02-18 Thread Miguel Dias Costa
Regarding the download issues, although there are alternatives (manually download, change source_urls and templates, etc.), if the issue is simply that it's slow I'd recommend using "eb Python-3.7.0-foss-2018b.eb -r --fetch" and leave it running for now Regarding the problem with building GCCc

Re: [easybuild] Obtain all the urls of the tarballs used by eb.

2020-02-18 Thread Hongyi Zhao
I try to use a locally http proxy to do the job as following, but still failed as follows: $ http_proxy="127.0.0.1:8118" eb Python-3.7.0-foss-2018b.eb -r --rebuild == temporary log file in case of crash /tmp/eb-kp_C77/easybuild-PNMkIf.log == resolving dependencies ... == processing EasyBuild easyc

Re: [easybuild] Slurm/MPI error on importing tensorflow

2020-02-18 Thread Loris Bennett
Åke Sandgren writes: > We set things up like this, > > things built with system compiler and libs outside of EasyBuild (/lap == > Locally Added Packages, this is where we used to install everything we > built before EB) > /lap/pmix, /lap/ucx, /lap/libevent, /lap/slurm > (And several versions of e

Re: [easybuild] Obtain all the urls of the tarballs used by eb.

2020-02-18 Thread Hongyi Zhao
Miguel Dias Costa 于2020年2月19日周三 下午12:38写道: > > Hello Hongsheng, > > On 19/02/2020 11:23, Hongyi Zhao wrote: > > Hi, > > > > Say for the following: > > $ eb Python-3.7.0-foss-2018b.eb > > > > The above command depends on many tarballs, > > Do you already have the toolchain foss/2018b installed? If

Re: [easybuild] Obtain all the urls of the tarballs used by eb.

2020-02-18 Thread Hongyi Zhao
Miguel Dias Costa 于2020年2月19日周三 下午12:38写道: > > Hello Hongsheng, > > On 19/02/2020 11:23, Hongyi Zhao wrote: > > Hi, > > > > Say for the following: > > $ eb Python-3.7.0-foss-2018b.eb > > > > The above command depends on many tarballs, > > Do you already have the toolchain foss/2018b installed? If

Re: [easybuild] Obtain all the urls of the tarballs used by eb.

2020-02-18 Thread Miguel Dias Costa
Hello Hongsheng, On 19/02/2020 11:23, Hongyi Zhao wrote: Hi, Say for the following: $ eb Python-3.7.0-foss-2018b.eb The above command depends on many tarballs, Do you already have the toolchain foss/2018b installed? If not, eb will need to download and build it from scratch, and that will t

[easybuild] Obtain all the urls of the tarballs used by eb.

2020-02-18 Thread Hongyi Zhao
Hi, Say for the following: $ eb Python-3.7.0-foss-2018b.eb The above command depends on many tarballs, and the downloading process with the eb is so slow. Is there some method for me to let eb output all of the used source tarballs urls? Regards -- Hongsheng Zhao Institute of Semiconductors, C

[easybuild] Very slow install process of easybuild to build softwares.

2020-02-18 Thread Hongyi Zhao
Hi, I try to run the following command to install python 3.7 with easybuild: $ eb Python-3.7.0-foss-2018b.eb But it's freeze at the following step for very long time: $ eb Python-3.7.0-foss-2018b.eb == temporary log file in case of crash /tmp/eb-mBP0pt/easybuild-sMIQzX.log == processing EasyBui

Re: [easybuild] Slurm/MPI error on importing tensorflow

2020-02-18 Thread Åke Sandgren
We set things up like this, things built with system compiler and libs outside of EasyBuild (/lap == Locally Added Packages, this is where we used to install everything we built before EB) /lap/pmix, /lap/ucx, /lap/libevent, /lap/slurm (And several versions of each below those dirs) Slurm is bui

Re: [easybuild] Slurm/MPI error on importing tensorflow

2020-02-18 Thread Loris Bennett
Åke Sandgren writes: > Since Slurm is built with the system compiler you should also build its > PMIx/UCX builds with the system compiler (and the corresponding libevent > in case you don't use the system version), and keep them separate from > the EB installation. Sorry, I'm confused again. Do

[easybuild] next EasyBuild conf call: Wed Feb 19th 2020 at **10am CET**

2020-02-18 Thread Kenneth Hoste
Dear EasyBuilders, The next EasyBuild conf call is planned for Wed Feb 19th 2020, at **10am CET**. Please note the different time! Based on the feedback we've received recently, we would like to start alternating between 10am CET & 5pm CET, to allow more people to frequently join the conf cal

Re: [easybuild] Slurm/MPI error on importing tensorflow

2020-02-18 Thread Åke Sandgren
Since Slurm is built with the system compiler you should also build its PMIx/UCX builds with the system compiler (and the corresponding libevent in case you don't use the system version), and keep them separate from the EB installation. (Also check the compatibility matrix for PMIx.) Build Slurm

Re: [easybuild] Slurm/MPI error on importing tensorflow

2020-02-18 Thread Loris Bennett
Loris Bennett writes: > Dear Andreas, > > I am not aware that we have ever built OpenMPI against a particular > version of Slurm before (before being in the last 10 years or so). > My very poor understanding is that both OpenMPI and Slurm support some > variants of PMI. As long as there is some