Re: Significant windows build improvements from source
I followed the directions and got stuck on OpenBLAS. Then I tried to just use MKL, but then mshadow build threw an error saying it required OpenBLAS. #11769 That whole part can really use some clarification. On Sat, Aug 4, 2018, 05:21 Pedro Larroy wrote: > Hi Qing > > The problem you are facing is while building opencv? > > We would need to automate dependency download and building as well as part > of an improved windows experience. Right now I only automated the build > steps assuming you have a working opencv and openblas build. This would be > the next step and if someone has cycles to contribute I would be happy to > review and assist. > > To summarize, yes the final goal is to have a fully automated setup that > requires one or at most a couple of commands / steps to get MXNet up and > running from sources in windows. If anyone is interested in helping with > this, let's coordinate here. > > Pedro > > On Fri, Aug 3, 2018 at 9:09 AM Qing Lan wrote: > > > Just an update from previous thread. > > > > I tried Windows build using > > http://mxnet.incubator.apache.org/install/windows_setup.html > instruction. > > The OpenCV links there only contains prebuilt vs12 (VS 2013). Apart from > > that, user need to create a new C++ project after VS2015 installation > > because it did not trigger the c compiler installation. I copied the > > command from Pedro's Python script and it improves a little. However, > even > > with these changes, I am still facing build failure. I think developers > may > > need some script to automate these process to build backend dependencies > on > > Windows. Do we have them already? > > > > Thanks, > > Qing > > > > On 8/2/18, 10:10 AM, "Qing Lan" wrote: > > > > Hi Pedro, > > > > Great works! Thanks for supporting Windows build in here. > > > > Thanks, > > Qing > > > > On 8/2/18, 10:08 AM, "Marco de Abreu" .INVALID> > > wrote: > > > > Hello Pedro, > > > > These are great efforts! It's great to see that we are improving > > our > > situation around Windows. > > > > Looking forward to using it. > > > > Best regards, > > Marco > > > > Pedro Larroy schrieb am Do., 2. > > Aug. 2018, > > 19:04: > > > > > Hi > > > > > > I have taken some effort to cleanup the Windows build process > > and condense > > > it in a single python script, provided that the required > > dependencies are > > > installed (opencv, openblas and cuda/cudnn in gpu). > > > > > > Now there's a single command necessary to get a build: > > > > > > python ci\build_windows.py > > > > > > The build flavour can be given with the '-f' argument. > > > > > > This produces a windows_package.7z file with MXNet libraries, > > python > > > bindings and includes. > > > > > > For testing, just running a powershell script like: > > > > > >ci/windows/test_py3_cpu.ps1 > > > > > > Will execute the unit tests. > > > > > > Let me know what you think. I pretty much would like to see > > these changes > > > in the release branch which will help with any windows issues > > that we might > > > find. > > > > > > https://github.com/apache/incubator-mxnet/pull/11947 > > > > > > Simple installation of dependencies and update to the > > documentation about > > > windows builds from source will come in the future. > > > > > > Pedro. > > > > > > > > > > > > > >
Re: Significant windows build improvements from source
Hi Qing The problem you are facing is while building opencv? We would need to automate dependency download and building as well as part of an improved windows experience. Right now I only automated the build steps assuming you have a working opencv and openblas build. This would be the next step and if someone has cycles to contribute I would be happy to review and assist. To summarize, yes the final goal is to have a fully automated setup that requires one or at most a couple of commands / steps to get MXNet up and running from sources in windows. If anyone is interested in helping with this, let's coordinate here. Pedro On Fri, Aug 3, 2018 at 9:09 AM Qing Lan wrote: > Just an update from previous thread. > > I tried Windows build using > http://mxnet.incubator.apache.org/install/windows_setup.html instruction. > The OpenCV links there only contains prebuilt vs12 (VS 2013). Apart from > that, user need to create a new C++ project after VS2015 installation > because it did not trigger the c compiler installation. I copied the > command from Pedro's Python script and it improves a little. However, even > with these changes, I am still facing build failure. I think developers may > need some script to automate these process to build backend dependencies on > Windows. Do we have them already? > > Thanks, > Qing > > On 8/2/18, 10:10 AM, "Qing Lan" wrote: > > Hi Pedro, > > Great works! Thanks for supporting Windows build in here. > > Thanks, > Qing > > On 8/2/18, 10:08 AM, "Marco de Abreu" > > wrote: > > Hello Pedro, > > These are great efforts! It's great to see that we are improving > our > situation around Windows. > > Looking forward to using it. > > Best regards, > Marco > > Pedro Larroy schrieb am Do., 2. > Aug. 2018, > 19:04: > > > Hi > > > > I have taken some effort to cleanup the Windows build process > and condense > > it in a single python script, provided that the required > dependencies are > > installed (opencv, openblas and cuda/cudnn in gpu). > > > > Now there's a single command necessary to get a build: > > > > python ci\build_windows.py > > > > The build flavour can be given with the '-f' argument. > > > > This produces a windows_package.7z file with MXNet libraries, > python > > bindings and includes. > > > > For testing, just running a powershell script like: > > > >ci/windows/test_py3_cpu.ps1 > > > > Will execute the unit tests. > > > > Let me know what you think. I pretty much would like to see > these changes > > in the release branch which will help with any windows issues > that we might > > find. > > > > https://github.com/apache/incubator-mxnet/pull/11947 > > > > Simple installation of dependencies and update to the > documentation about > > windows builds from source will come in the future. > > > > Pedro. > > > > > > >
Re: Significant windows build improvements from source
Just an update from previous thread. I tried Windows build using http://mxnet.incubator.apache.org/install/windows_setup.html instruction. The OpenCV links there only contains prebuilt vs12 (VS 2013). Apart from that, user need to create a new C++ project after VS2015 installation because it did not trigger the c compiler installation. I copied the command from Pedro's Python script and it improves a little. However, even with these changes, I am still facing build failure. I think developers may need some script to automate these process to build backend dependencies on Windows. Do we have them already? Thanks, Qing On 8/2/18, 10:10 AM, "Qing Lan" wrote: Hi Pedro, Great works! Thanks for supporting Windows build in here. Thanks, Qing On 8/2/18, 10:08 AM, "Marco de Abreu" wrote: Hello Pedro, These are great efforts! It's great to see that we are improving our situation around Windows. Looking forward to using it. Best regards, Marco Pedro Larroy schrieb am Do., 2. Aug. 2018, 19:04: > Hi > > I have taken some effort to cleanup the Windows build process and condense > it in a single python script, provided that the required dependencies are > installed (opencv, openblas and cuda/cudnn in gpu). > > Now there's a single command necessary to get a build: > > python ci\build_windows.py > > The build flavour can be given with the '-f' argument. > > This produces a windows_package.7z file with MXNet libraries, python > bindings and includes. > > For testing, just running a powershell script like: > >ci/windows/test_py3_cpu.ps1 > > Will execute the unit tests. > > Let me know what you think. I pretty much would like to see these changes > in the release branch which will help with any windows issues that we might > find. > > https://github.com/apache/incubator-mxnet/pull/11947 > > Simple installation of dependencies and update to the documentation about > windows builds from source will come in the future. > > Pedro. >
Re: Significant windows build improvements from source
Hi Pedro, Great works! Thanks for supporting Windows build in here. Thanks, Qing On 8/2/18, 10:08 AM, "Marco de Abreu" wrote: Hello Pedro, These are great efforts! It's great to see that we are improving our situation around Windows. Looking forward to using it. Best regards, Marco Pedro Larroy schrieb am Do., 2. Aug. 2018, 19:04: > Hi > > I have taken some effort to cleanup the Windows build process and condense > it in a single python script, provided that the required dependencies are > installed (opencv, openblas and cuda/cudnn in gpu). > > Now there's a single command necessary to get a build: > > python ci\build_windows.py > > The build flavour can be given with the '-f' argument. > > This produces a windows_package.7z file with MXNet libraries, python > bindings and includes. > > For testing, just running a powershell script like: > >ci/windows/test_py3_cpu.ps1 > > Will execute the unit tests. > > Let me know what you think. I pretty much would like to see these changes > in the release branch which will help with any windows issues that we might > find. > > https://github.com/apache/incubator-mxnet/pull/11947 > > Simple installation of dependencies and update to the documentation about > windows builds from source will come in the future. > > Pedro. >
Re: Significant windows build improvements from source
Hello Pedro, These are great efforts! It's great to see that we are improving our situation around Windows. Looking forward to using it. Best regards, Marco Pedro Larroy schrieb am Do., 2. Aug. 2018, 19:04: > Hi > > I have taken some effort to cleanup the Windows build process and condense > it in a single python script, provided that the required dependencies are > installed (opencv, openblas and cuda/cudnn in gpu). > > Now there's a single command necessary to get a build: > > python ci\build_windows.py > > The build flavour can be given with the '-f' argument. > > This produces a windows_package.7z file with MXNet libraries, python > bindings and includes. > > For testing, just running a powershell script like: > >ci/windows/test_py3_cpu.ps1 > > Will execute the unit tests. > > Let me know what you think. I pretty much would like to see these changes > in the release branch which will help with any windows issues that we might > find. > > https://github.com/apache/incubator-mxnet/pull/11947 > > Simple installation of dependencies and update to the documentation about > windows builds from source will come in the future. > > Pedro. >
Significant windows build improvements from source
Hi I have taken some effort to cleanup the Windows build process and condense it in a single python script, provided that the required dependencies are installed (opencv, openblas and cuda/cudnn in gpu). Now there's a single command necessary to get a build: python ci\build_windows.py The build flavour can be given with the '-f' argument. This produces a windows_package.7z file with MXNet libraries, python bindings and includes. For testing, just running a powershell script like: ci/windows/test_py3_cpu.ps1 Will execute the unit tests. Let me know what you think. I pretty much would like to see these changes in the release branch which will help with any windows issues that we might find. https://github.com/apache/incubator-mxnet/pull/11947 Simple installation of dependencies and update to the documentation about windows builds from source will come in the future. Pedro.
