Re: [Announce] Runtime feature detection
Thanks, Pedro for contributing this long awaiting feature. I can immediately use it for Horovod project now. Bravo! Lin On Tue, Feb 12, 2019 at 2:42 AM Pedro Larroy wrote: > An update on this topic, Sheng just merged the refinements to the > feature detection so it's now a single API call. ( > https://github.com/apache/incubator-mxnet/pull/13964 ). Thank you > Sheng for the reviews. > > Please use this functionality to check for capabilities of MXNet at > runtime such as Cuda, OpenCV etc. This can simplify tests and > automation in several places in the code. > > Lin Iblis is already preparing Julia support: > https://github.com/apache/incubator-mxnet/pull/13992 > > This is a PR that adds documentation on the feature and explains how > to use it from Python: > https://github.com/apache/incubator-mxnet/pull/14130 > > Thanks. > > On Fri, Jan 25, 2019 at 7:08 PM Sheng Zha wrote: > > > > Hi Pedro, > > > > Happy to help, though I was waiting for PR comments to be addressed. > Currently the PR is close to complete, with some open comments to be > resolved. > > > > -sz > > > > > On Jan 25, 2019, at 9:27 AM, Pedro Larroy < > pedro.larroy.li...@gmail.com> wrote: > > > > > > That's Great! There's a PR that we should merge first which > > > internalizes the enum inside the library as per Sheng's suggestion. > > > > > > https://github.com/apache/incubator-mxnet/pull/13964 > > > > > > @Sheng could we merge the PR? so we can build on top of this feature? > > > It's badly needed for tests suites etc. > > > Thanks a lot! > > > > > > Pedro. > > > > > > > > >> On Fri, Jan 25, 2019 at 2:22 PM Iblis Lin > wrote: > > >> > > >> Hi, > > >> > > >> I added the Julia binding for it. > > >> PR is here: > > >> https://github.com/apache/incubator-mxnet/pull/13992 > > >> > > >> Iblis Lin > > >> 林峻頤 > > >> > > >>> On 1/23/19 12:39 AM, Pedro Larroy wrote: > > >>> Hi > > >>> > > >>> I'm pleased to announce that runtime feature detection has been > merged > > >>> in master, thanks to Aaron for the merge and the many reviewers who > > >>> gave feedback on the PR. ( > > >>> https://github.com/apache/incubator-mxnet/pull/13549 ) > > >>> > > >>> As the functionality matures and is exposed through other bindings, > > >>> please feel free to try and use it to build on it, for example for > > >>> easier test suite selection depending on what's compiled in the > > >>> engine. > > >>> > > >>> Usage examples: > > >>> > > >>> $ ipython > > >>> In [4]: import mxnet.mxfeatures > > >>> > > >>> In [5]: mxnet.mxfeatures.features_enabled() > > >>> Out[5]: > > >>> [, > > >>> , > > >>> , > > >>> , > > >>> , > > >>> , > > >>> , > > >>> , > > >>> , > > >>> , > > >>> ] > > >>> > > >>> In [6]: mxnet.mxfeatures.features_enabled_str() > > >>> Out[6]: 'CPU_SSE, CPU_SSE2, CPU_SSE3, CPU_SSE4_1, CPU_SSE4_2, > CPU_AVX, > > >>> F16C, BLAS_OPEN, LAPACK, SIGNAL_HANDLER, DEBUG' > > >>> > > >>> see also: help(mxnet.mxfeatures) > > >>> > > >>> Regards. > > >>> >
Re: [Announce] Runtime feature detection
An update on this topic, Sheng just merged the refinements to the feature detection so it's now a single API call. ( https://github.com/apache/incubator-mxnet/pull/13964 ). Thank you Sheng for the reviews. Please use this functionality to check for capabilities of MXNet at runtime such as Cuda, OpenCV etc. This can simplify tests and automation in several places in the code. Lin Iblis is already preparing Julia support: https://github.com/apache/incubator-mxnet/pull/13992 This is a PR that adds documentation on the feature and explains how to use it from Python: https://github.com/apache/incubator-mxnet/pull/14130 Thanks. On Fri, Jan 25, 2019 at 7:08 PM Sheng Zha wrote: > > Hi Pedro, > > Happy to help, though I was waiting for PR comments to be addressed. > Currently the PR is close to complete, with some open comments to be resolved. > > -sz > > > On Jan 25, 2019, at 9:27 AM, Pedro Larroy > > wrote: > > > > That's Great! There's a PR that we should merge first which > > internalizes the enum inside the library as per Sheng's suggestion. > > > > https://github.com/apache/incubator-mxnet/pull/13964 > > > > @Sheng could we merge the PR? so we can build on top of this feature? > > It's badly needed for tests suites etc. > > Thanks a lot! > > > > Pedro. > > > > > >> On Fri, Jan 25, 2019 at 2:22 PM Iblis Lin wrote: > >> > >> Hi, > >> > >> I added the Julia binding for it. > >> PR is here: > >> https://github.com/apache/incubator-mxnet/pull/13992 > >> > >> Iblis Lin > >> 林峻頤 > >> > >>> On 1/23/19 12:39 AM, Pedro Larroy wrote: > >>> Hi > >>> > >>> I'm pleased to announce that runtime feature detection has been merged > >>> in master, thanks to Aaron for the merge and the many reviewers who > >>> gave feedback on the PR. ( > >>> https://github.com/apache/incubator-mxnet/pull/13549 ) > >>> > >>> As the functionality matures and is exposed through other bindings, > >>> please feel free to try and use it to build on it, for example for > >>> easier test suite selection depending on what's compiled in the > >>> engine. > >>> > >>> Usage examples: > >>> > >>> $ ipython > >>> In [4]: import mxnet.mxfeatures > >>> > >>> In [5]: mxnet.mxfeatures.features_enabled() > >>> Out[5]: > >>> [, > >>> , > >>> , > >>> , > >>> , > >>> , > >>> , > >>> , > >>> , > >>> , > >>> ] > >>> > >>> In [6]: mxnet.mxfeatures.features_enabled_str() > >>> Out[6]: 'CPU_SSE, CPU_SSE2, CPU_SSE3, CPU_SSE4_1, CPU_SSE4_2, CPU_AVX, > >>> F16C, BLAS_OPEN, LAPACK, SIGNAL_HANDLER, DEBUG' > >>> > >>> see also: help(mxnet.mxfeatures) > >>> > >>> Regards. > >>>
Re: [Announce] Runtime feature detection
Hi Pedro, Happy to help, though I was waiting for PR comments to be addressed. Currently the PR is close to complete, with some open comments to be resolved. -sz > On Jan 25, 2019, at 9:27 AM, Pedro Larroy > wrote: > > That's Great! There's a PR that we should merge first which > internalizes the enum inside the library as per Sheng's suggestion. > > https://github.com/apache/incubator-mxnet/pull/13964 > > @Sheng could we merge the PR? so we can build on top of this feature? > It's badly needed for tests suites etc. > Thanks a lot! > > Pedro. > > >> On Fri, Jan 25, 2019 at 2:22 PM Iblis Lin wrote: >> >> Hi, >> >> I added the Julia binding for it. >> PR is here: >> https://github.com/apache/incubator-mxnet/pull/13992 >> >> Iblis Lin >> 林峻頤 >> >>> On 1/23/19 12:39 AM, Pedro Larroy wrote: >>> Hi >>> >>> I'm pleased to announce that runtime feature detection has been merged >>> in master, thanks to Aaron for the merge and the many reviewers who >>> gave feedback on the PR. ( >>> https://github.com/apache/incubator-mxnet/pull/13549 ) >>> >>> As the functionality matures and is exposed through other bindings, >>> please feel free to try and use it to build on it, for example for >>> easier test suite selection depending on what's compiled in the >>> engine. >>> >>> Usage examples: >>> >>> $ ipython >>> In [4]: import mxnet.mxfeatures >>> >>> In [5]: mxnet.mxfeatures.features_enabled() >>> Out[5]: >>> [, >>> , >>> , >>> , >>> , >>> , >>> , >>> , >>> , >>> , >>> ] >>> >>> In [6]: mxnet.mxfeatures.features_enabled_str() >>> Out[6]: 'CPU_SSE, CPU_SSE2, CPU_SSE3, CPU_SSE4_1, CPU_SSE4_2, CPU_AVX, >>> F16C, BLAS_OPEN, LAPACK, SIGNAL_HANDLER, DEBUG' >>> >>> see also: help(mxnet.mxfeatures) >>> >>> Regards. >>>
Re: [Announce] Runtime feature detection
That's Great! There's a PR that we should merge first which internalizes the enum inside the library as per Sheng's suggestion. https://github.com/apache/incubator-mxnet/pull/13964 @Sheng could we merge the PR? so we can build on top of this feature? It's badly needed for tests suites etc. Thanks a lot! Pedro. On Fri, Jan 25, 2019 at 2:22 PM Iblis Lin wrote: > > Hi, > > I added the Julia binding for it. > PR is here: > https://github.com/apache/incubator-mxnet/pull/13992 > > Iblis Lin > 林峻頤 > > On 1/23/19 12:39 AM, Pedro Larroy wrote: > > Hi > > > > I'm pleased to announce that runtime feature detection has been merged > > in master, thanks to Aaron for the merge and the many reviewers who > > gave feedback on the PR. ( > > https://github.com/apache/incubator-mxnet/pull/13549 ) > > > > As the functionality matures and is exposed through other bindings, > > please feel free to try and use it to build on it, for example for > > easier test suite selection depending on what's compiled in the > > engine. > > > > Usage examples: > > > > $ ipython > > In [4]: import mxnet.mxfeatures > > > > In [5]: mxnet.mxfeatures.features_enabled() > > Out[5]: > > [, > > , > > , > > , > > , > > , > > , > > , > > , > > , > > ] > > > > In [6]: mxnet.mxfeatures.features_enabled_str() > > Out[6]: 'CPU_SSE, CPU_SSE2, CPU_SSE3, CPU_SSE4_1, CPU_SSE4_2, CPU_AVX, > > F16C, BLAS_OPEN, LAPACK, SIGNAL_HANDLER, DEBUG' > > > > see also: help(mxnet.mxfeatures) > > > > Regards. > >
Re: [Announce] Runtime feature detection
Hi, I added the Julia binding for it. PR is here: https://github.com/apache/incubator-mxnet/pull/13992 Iblis Lin 林峻頤 On 1/23/19 12:39 AM, Pedro Larroy wrote: > Hi > > I'm pleased to announce that runtime feature detection has been merged > in master, thanks to Aaron for the merge and the many reviewers who > gave feedback on the PR. ( > https://github.com/apache/incubator-mxnet/pull/13549 ) > > As the functionality matures and is exposed through other bindings, > please feel free to try and use it to build on it, for example for > easier test suite selection depending on what's compiled in the > engine. > > Usage examples: > > $ ipython > In [4]: import mxnet.mxfeatures > > In [5]: mxnet.mxfeatures.features_enabled() > Out[5]: > [, > , > , > , > , > , > , > , > , > , > ] > > In [6]: mxnet.mxfeatures.features_enabled_str() > Out[6]: 'CPU_SSE, CPU_SSE2, CPU_SSE3, CPU_SSE4_1, CPU_SSE4_2, CPU_AVX, > F16C, BLAS_OPEN, LAPACK, SIGNAL_HANDLER, DEBUG' > > see also: help(mxnet.mxfeatures) > > Regards. >
Re: [Announce] Runtime feature detection
well, in case of MXNet, it's mixed with MD and RST. The docs under dir `docs/` is written in MD. (MD is supported via sphinx plugin.) For the function docstring in Python, it's written in RST. The docstring will be rendered via a sphinx feature -- "autodoc". You can check this as an example: https://github.com/apache/incubator-mxnet/blob/master/docs/api/python/autograd/autograd.md#api-reference Iblis Lin 林峻頤 On 1/23/19 11:16 PM, Pedro Larroy wrote: I'm still refining the feature given some late feedback and that it will be public API. I guess with the help of Aaron we will get some nice documentation in, as it's not showing up in the master python API docs. I thought it would be taken automatically from the Python doc. Is this a correct source for the documentation format that we are using? I know we use sphynx but doesn't look like RST to me: http://www.sphinx-doc.org/en/master/usage/quickstart.html Pedro.
Re: [Announce] Runtime feature detection
I'm still refining the feature given some late feedback and that it will be public API. I guess with the help of Aaron we will get some nice documentation in, as it's not showing up in the master python API docs. I thought it would be taken automatically from the Python doc. Is this a correct source for the documentation format that we are using? I know we use sphynx but doesn't look like RST to me: http://www.sphinx-doc.org/en/master/usage/quickstart.html Pedro.
Re: [Announce] Runtime feature detection
This is awesome!!! Great stuff Pedro! Is this added to any of the documentation yet? Sam > On Jan 22, 2019, at 8:39 AM, Pedro Larroy > wrote: > > Hi > > I'm pleased to announce that runtime feature detection has been merged > in master, thanks to Aaron for the merge and the many reviewers who > gave feedback on the PR. ( > https://github.com/apache/incubator-mxnet/pull/13549 ) > > As the functionality matures and is exposed through other bindings, > please feel free to try and use it to build on it, for example for > easier test suite selection depending on what's compiled in the > engine. > > Usage examples: > > $ ipython > In [4]: import mxnet.mxfeatures > > In [5]: mxnet.mxfeatures.features_enabled() > Out[5]: > [, > , > , > , > , > , > , > , > , > , > ] > > In [6]: mxnet.mxfeatures.features_enabled_str() > Out[6]: 'CPU_SSE, CPU_SSE2, CPU_SSE3, CPU_SSE4_1, CPU_SSE4_2, CPU_AVX, > F16C, BLAS_OPEN, LAPACK, SIGNAL_HANDLER, DEBUG' > > see also: help(mxnet.mxfeatures) > > Regards.
[Announce] Runtime feature detection
Hi I'm pleased to announce that runtime feature detection has been merged in master, thanks to Aaron for the merge and the many reviewers who gave feedback on the PR. ( https://github.com/apache/incubator-mxnet/pull/13549 ) As the functionality matures and is exposed through other bindings, please feel free to try and use it to build on it, for example for easier test suite selection depending on what's compiled in the engine. Usage examples: $ ipython In [4]: import mxnet.mxfeatures In [5]: mxnet.mxfeatures.features_enabled() Out[5]: [, , , , , , , , , , ] In [6]: mxnet.mxfeatures.features_enabled_str() Out[6]: 'CPU_SSE, CPU_SSE2, CPU_SSE3, CPU_SSE4_1, CPU_SSE4_2, CPU_AVX, F16C, BLAS_OPEN, LAPACK, SIGNAL_HANDLER, DEBUG' see also: help(mxnet.mxfeatures) Regards.
