[GitHub] [incubator-mxnet] Sunhil commented on issue #17826: [quetions] Check failed: e == cudaSuccess: CUDA: initialization error
Sunhil commented on issue #17826: URL: https://github.com/apache/incubator-mxnet/issues/17826#issuecomment-655232370 Have you solved the problem? If you have soled the problem, Clould you show the solution? I have the same question, Thanks a lot! This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[incubator-mxnet-site] branch asf-site updated: Publish triggered by CI
This is an automated email from the ASF dual-hosted git repository. aaronmarkham pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/incubator-mxnet-site.git The following commit(s) were added to refs/heads/asf-site by this push: new 0e47dfc Publish triggered by CI 0e47dfc is described below commit 0e47dfcc17a83246b76b19db5edc58a7ad148bf5 Author: mxnet-ci AuthorDate: Wed Jul 8 00:41:02 2020 + Publish triggered by CI --- assets/main.css| 2 +- assets/main.css.map| 4 +- date.txt | 1 - feed.xml | 2 +- get_started/index.html | 121 + 5 files changed, 35 insertions(+), 95 deletions(-) diff --git a/assets/main.css b/assets/main.css index 6a6ea24..7e2eb85 100644 --- a/assets/main.css +++ b/assets/main.css @@ -528,7 +528,7 @@ figure { margin-bottom: 0 !important; } .docs-dev-guide { background-color: white; padding-top: 20px; padding-bottom: 20px; } -.install-selector { max-width: 800px; margin: auto; margin-bottom: 40px; } +.install-selector { max-width: 800px; margin: auto; margin-bottom: 40px; padding-bottom: 40px; padding-top: 40px; } .install-selector .highlight { margin-left: 20px; margin-top: 20px; margin-bottom: 20px !important; } diff --git a/assets/main.css.map b/assets/main.css.map index e255cc0..8e03202 100644 --- a/assets/main.css.map +++ b/assets/main.css.map @@ -31,12 +31,12 @@ ".feature-image {\n max-width: 100px;\n filter: grayscale(1);\n margin: auto;\n}\n\n.feature-paragraph {\n margin: auto;\n}\n\n.feature-title {\n float: left;\n margin-bottom: 0px;\n}\n\n.highlight pre {\n box-shadow: inset 0 -2px 0 0 $color-mxnet;\n margin-bottom: 0 !important;\n}\n\nfigure {\n margin-bottom: 0 !important;\n}", ".ecosystem-page {\n .card {\nbackground-color: $grey-color-light;\n }\n\n h4 {\nfloat: left;\n }\n}", ".docs-logo-docs {\n width: 25px;\n padding-bottom: 4px;\n margin-right: 10px;\n}\n\n.docs-logo-container {\n margin: auto;\n text-align: center;\n margin-bottom: 20px;\n\n img.docs-logo-image {\n height: 75px;\nmargin: auto;\n }\n}\n\n.docs-side-bar {\n margin-left: 0px !important;\n padding-right: 10px;\n background-color: $grey-color-light;\n}\n\n.docs-hero {\n margin-bottom: 20px;\n}\n\n.docs-hero-left {\n\n}\n\n.docs-hero-right {\n\n}\n\n.docs-card {\n backgrou [...] - ".install-selector {\n max-width: 800px;\n margin: auto;\n margin-bottom: 40px;\n\n .highlight {\nmargin-left: 20px;\nmargin-top: 20px;\nmargin-bottom: 20px !important;\n }\n}\n\n\n.install-content, .install-widget {\n visibility: hidden;\n}\n\n.get-started-from-source {\n background-color: $grey-color-light;\n padding-top: 50px;\n padding-bottom: 50px;\n}\n\n#lang-demo ul {\n margin-top: 20px;\n margin-bottom: 15px;\n}\n\n.option-title {\n width: 100px;\n floa [...] + ".install-selector {\n max-width: 800px;\n margin: auto;\n margin-bottom: 40px;\n padding-bottom: 40px;\n padding-top: 40px;\n\n .highlight {\nmargin-left: 20px;\nmargin-top: 20px;\nmargin-bottom: 20px !important;\n }\n}\n\n\n.install-content, .install-widget {\n visibility: hidden;\n}\n\n.get-started-from-source {\n background-color: $grey-color-light;\n padding-top: 50px;\n padding-bottom: 50px;\n}\n\n#lang-demo ul {\n margin-top: 20px;\n margin-bottom: 15px; [...] ".highlight .hll {\n background-color: #cc\n}\n\n.highlight {\n background: #f0f3f3;\n}\n\n.highlight .c {\n color: #0099FF;\n font-style: italic\n}\n\n/* Comment */\n.highlight .err {\n color: #AA;\n background-color: #FF\n}\n\n/* Error */\n.highlight .k {\n color: #006699;\n font-weight: bold\n}\n\n/* Keyword */\n.highlight .o {\n color: #55\n}\n\n/* Operator */\n.highlight .ch {\n color: #0099FF;\n font-style: italic\n}\n\n/* Comment.Hashbang */\n.highligh [...] ".trigger {\n float: right;\n}\n\n/* Search bar - wide screen */\n.gs-search-border {\n padding-left: 25px;\n float: right;\n}\n\n#global-search {\n width: 0px;\n border: 0px;\n background-color: transparent;\n border-bottom: 1px solid rgba(0, 0, 0, 0.12);\n outline: none;\n font-size: 1em;\n color: #ff;\n display: inline-block;\n margin-bottom: 19px;\n}\n\n#gs-search-icon {\n background: url(/assets/img/search-icon.svg) center no-repeat;\n background-size: 1em;\n he [...] ".dropdown-option-active {\n color: #ff4500 !important;\n font-weight: lighter;\n}\n\n.dropdown {\n position: relative;\n display: inline-block;\n}\n\n.dropdown-content {\n display: none;\n position: absolute;\n background-color: #f9f9f9;\n min-width: 160px;\n box-shadow: 0px 8px 16px 0px rgba(0, 0, 0, 0.2);\n padding: 12px 16px;\n z-index: 1;\n text-align: left;\n}\n\n.dropdown:hover
[incubator-mxnet-site] branch asf-site updated: Publish triggered by CI
This is an automated email from the ASF dual-hosted git repository. aaronmarkham pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/incubator-mxnet-site.git The following commit(s) were added to refs/heads/asf-site by this push: new 0e47dfc Publish triggered by CI 0e47dfc is described below commit 0e47dfcc17a83246b76b19db5edc58a7ad148bf5 Author: mxnet-ci AuthorDate: Wed Jul 8 00:41:02 2020 + Publish triggered by CI --- assets/main.css| 2 +- assets/main.css.map| 4 +- date.txt | 1 - feed.xml | 2 +- get_started/index.html | 121 + 5 files changed, 35 insertions(+), 95 deletions(-) diff --git a/assets/main.css b/assets/main.css index 6a6ea24..7e2eb85 100644 --- a/assets/main.css +++ b/assets/main.css @@ -528,7 +528,7 @@ figure { margin-bottom: 0 !important; } .docs-dev-guide { background-color: white; padding-top: 20px; padding-bottom: 20px; } -.install-selector { max-width: 800px; margin: auto; margin-bottom: 40px; } +.install-selector { max-width: 800px; margin: auto; margin-bottom: 40px; padding-bottom: 40px; padding-top: 40px; } .install-selector .highlight { margin-left: 20px; margin-top: 20px; margin-bottom: 20px !important; } diff --git a/assets/main.css.map b/assets/main.css.map index e255cc0..8e03202 100644 --- a/assets/main.css.map +++ b/assets/main.css.map @@ -31,12 +31,12 @@ ".feature-image {\n max-width: 100px;\n filter: grayscale(1);\n margin: auto;\n}\n\n.feature-paragraph {\n margin: auto;\n}\n\n.feature-title {\n float: left;\n margin-bottom: 0px;\n}\n\n.highlight pre {\n box-shadow: inset 0 -2px 0 0 $color-mxnet;\n margin-bottom: 0 !important;\n}\n\nfigure {\n margin-bottom: 0 !important;\n}", ".ecosystem-page {\n .card {\nbackground-color: $grey-color-light;\n }\n\n h4 {\nfloat: left;\n }\n}", ".docs-logo-docs {\n width: 25px;\n padding-bottom: 4px;\n margin-right: 10px;\n}\n\n.docs-logo-container {\n margin: auto;\n text-align: center;\n margin-bottom: 20px;\n\n img.docs-logo-image {\n height: 75px;\nmargin: auto;\n }\n}\n\n.docs-side-bar {\n margin-left: 0px !important;\n padding-right: 10px;\n background-color: $grey-color-light;\n}\n\n.docs-hero {\n margin-bottom: 20px;\n}\n\n.docs-hero-left {\n\n}\n\n.docs-hero-right {\n\n}\n\n.docs-card {\n backgrou [...] - ".install-selector {\n max-width: 800px;\n margin: auto;\n margin-bottom: 40px;\n\n .highlight {\nmargin-left: 20px;\nmargin-top: 20px;\nmargin-bottom: 20px !important;\n }\n}\n\n\n.install-content, .install-widget {\n visibility: hidden;\n}\n\n.get-started-from-source {\n background-color: $grey-color-light;\n padding-top: 50px;\n padding-bottom: 50px;\n}\n\n#lang-demo ul {\n margin-top: 20px;\n margin-bottom: 15px;\n}\n\n.option-title {\n width: 100px;\n floa [...] + ".install-selector {\n max-width: 800px;\n margin: auto;\n margin-bottom: 40px;\n padding-bottom: 40px;\n padding-top: 40px;\n\n .highlight {\nmargin-left: 20px;\nmargin-top: 20px;\nmargin-bottom: 20px !important;\n }\n}\n\n\n.install-content, .install-widget {\n visibility: hidden;\n}\n\n.get-started-from-source {\n background-color: $grey-color-light;\n padding-top: 50px;\n padding-bottom: 50px;\n}\n\n#lang-demo ul {\n margin-top: 20px;\n margin-bottom: 15px; [...] ".highlight .hll {\n background-color: #cc\n}\n\n.highlight {\n background: #f0f3f3;\n}\n\n.highlight .c {\n color: #0099FF;\n font-style: italic\n}\n\n/* Comment */\n.highlight .err {\n color: #AA;\n background-color: #FF\n}\n\n/* Error */\n.highlight .k {\n color: #006699;\n font-weight: bold\n}\n\n/* Keyword */\n.highlight .o {\n color: #55\n}\n\n/* Operator */\n.highlight .ch {\n color: #0099FF;\n font-style: italic\n}\n\n/* Comment.Hashbang */\n.highligh [...] ".trigger {\n float: right;\n}\n\n/* Search bar - wide screen */\n.gs-search-border {\n padding-left: 25px;\n float: right;\n}\n\n#global-search {\n width: 0px;\n border: 0px;\n background-color: transparent;\n border-bottom: 1px solid rgba(0, 0, 0, 0.12);\n outline: none;\n font-size: 1em;\n color: #ff;\n display: inline-block;\n margin-bottom: 19px;\n}\n\n#gs-search-icon {\n background: url(/assets/img/search-icon.svg) center no-repeat;\n background-size: 1em;\n he [...] ".dropdown-option-active {\n color: #ff4500 !important;\n font-weight: lighter;\n}\n\n.dropdown {\n position: relative;\n display: inline-block;\n}\n\n.dropdown-content {\n display: none;\n position: absolute;\n background-color: #f9f9f9;\n min-width: 160px;\n box-shadow: 0px 8px 16px 0px rgba(0, 0, 0, 0.2);\n padding: 12px 16px;\n z-index: 1;\n text-align: left;\n}\n\n.dropdown:hover
[incubator-mxnet-site] branch asf-site updated: Bump the publish timestamp.
This is an automated email from the ASF dual-hosted git repository. aaronmarkham pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/incubator-mxnet-site.git The following commit(s) were added to refs/heads/asf-site by this push: new 72faa11 Bump the publish timestamp. 72faa11 is described below commit 72faa11ab9ab0cdd955f65b7774efbc1bf86ece2 Author: mxnet-ci AuthorDate: Wed Jul 8 00:41:12 2020 + Bump the publish timestamp. --- date.txt | 1 + 1 file changed, 1 insertion(+) diff --git a/date.txt b/date.txt new file mode 100644 index 000..5508ae8 --- /dev/null +++ b/date.txt @@ -0,0 +1 @@ +Wed Jul 8 00:41:12 UTC 2020
[incubator-mxnet-site] branch asf-site updated: Bump the publish timestamp.
This is an automated email from the ASF dual-hosted git repository. aaronmarkham pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/incubator-mxnet-site.git The following commit(s) were added to refs/heads/asf-site by this push: new 72faa11 Bump the publish timestamp. 72faa11 is described below commit 72faa11ab9ab0cdd955f65b7774efbc1bf86ece2 Author: mxnet-ci AuthorDate: Wed Jul 8 00:41:12 2020 + Bump the publish timestamp. --- date.txt | 1 + 1 file changed, 1 insertion(+) diff --git a/date.txt b/date.txt new file mode 100644 index 000..5508ae8 --- /dev/null +++ b/date.txt @@ -0,0 +1 @@ +Wed Jul 8 00:41:12 UTC 2020
[GitHub] [incubator-mxnet] xcgoner opened a new issue #18669: Inconsistency of output and states in ZoneoutCell
xcgoner opened a new issue #18669: URL: https://github.com/apache/incubator-mxnet/issues/18669 ## Description In the implementation of ZoneoutCell: https://github.com/apache/incubator-mxnet/blob/master/python/mxnet/gluon/rnn/rnn_cell.py The output and states are using 2 different masks. However, if we use an RNNCell (e.g., LSTMCell or GRUCell) as the base cell, output is also a part of states (typically the first element of states). As a result, there will be cases like output is using the previous output, while the output inside states is the next output, which causes inconsistency. A correct implementation should be: applying a mask to the output first, and then replace the output inside states with the new output, then apply another mask to the remaining part of states. Maybe a better way to fix this is to directly implement LSTMCell and GRUCell with Zoneout, instead of using ModifierCell. Note that the symbolic version of ZoneoutCell has the same issue, though I only report the issue of the gluon version here. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [incubator-mxnet] ys2843 commented on issue #18566: Merge numpy.mxnet.io to MXNet official website
ys2843 commented on issue #18566: URL: https://github.com/apache/incubator-mxnet/issues/18566#issuecomment-655167581 ## Introduction MXNet Numpy website hosts essential documents about the usage of MXNet APIs, it is important to share these contents with all MXNet community and new users. In this project, a plan for merging [numpy.mxnet.io](http://numpy.mxnet.io/) to MXNet official website is proposed to achieve above goals. ## Problems Contents from [numpy.mxnet.io](http://numpy.mxnet.io/) should be ported to MXNet official website ## Proposed Solution Given that MXNet and Numpy website contains similar contents that diverged from a point due to different maintaining teams, we will select the contents with latest updates to host on MXNet website. There are mainly 4 sections on Numpy website, here is a summary of each section compared to MXNet website: ### **Contents on [numpy.mxnet.io](http://numpy.mxnet.io/)** * *Guide/Getting started with NP on MXNet* : Contains 6 updated version of [Crash Course](https://mxnet.apache.org/api/python/docs/tutorials/getting-started/crash-course/index.html) under `Python/Tutorials/Get Started/Crash Course`, will overwrite current crash course documents * *Guide/What is NP on MXNet*: These are new contents that should be added to main site, proposed location: `/Python/Tutorials/Get Started/What is NP on MXNet` * *API/NP on MXNet reference*: New contents about NP API, will be added to main site. Proposed location: `/Python/Tutorials/Packages/NDArray/``NP on MXNet reference` * *API/Gluon reference [Deprecated]*: A subset of [current Gluon Tutorials](https://mxnet.apache.org/api/python/docs/tutorials/packages/gluon/index.html), will not make it to main site ### Proposed File Changes on MXNet Website Please see project proposal Quip link. ## Implementation Timeline July 13th - July 17th - **Migrate all contents from Numpy website to MXNet website** * Migrate relating rst files to MXNet Python website code, fix incompatible bugs July 20th - July 24th - **Close down Numpy website and redirect traffic to MXNet website** * Implement redirect and possible url mapping ## Reference 1. MXNet numpy website: https://numpy.mxnet.io/ 2. Numpy website Github link: https://github.com/mli/deepnumpy-doc 3. Project proposal Quip link: https://quip-amazon.com/DBY4APbnpQKa/Merge-numpymxnetio-to-MXNet-Official-Website This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[incubator-mxnet] branch master updated: fix broken installation widget - remove empty entries (#18661)
This is an automated email from the ASF dual-hosted git repository. lausen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-mxnet.git The following commit(s) were added to refs/heads/master by this push: new 348ab4d fix broken installation widget - remove empty entries (#18661) 348ab4d is described below commit 348ab4d8d77359bf60d97a0befbd9086fd52ee49 Author: Yang Shi AuthorDate: Tue Jul 7 15:06:34 2020 -0700 fix broken installation widget - remove empty entries (#18661) --- .../src/_includes/get_started/get_started.html | 121 ++--- .../src/_sass/minima/_getting_started.scss | 2 + 2 files changed, 33 insertions(+), 90 deletions(-) diff --git a/docs/static_site/src/_includes/get_started/get_started.html b/docs/static_site/src/_includes/get_started/get_started.html index 60cafed..8123bf2 100644 --- a/docs/static_site/src/_includes/get_started/get_started.html +++ b/docs/static_site/src/_includes/get_started/get_started.html @@ -85,14 +85,16 @@ - - -GPU / CPU - - - -GPU -CPU + + + +GPU / CPU + + + +GPU +CPU + @@ -133,25 +135,6 @@ - - - - - - -Distribution - - - -Pkg -Build from Source - - - - - - - @@ -198,48 +181,34 @@ - -{% markdown %}{% include /get_started/linux/r/build-from-source.md %}{% endmarkdown %} - +{% markdown %}{% include /get_started/linux/r/build-from-source.md %}{% endmarkdown %} - -{% markdown %}{% include /get_started/linux/scala/build-from-source.md %}{% endmarkdown %} - +{% markdown %}{% include /get_started/linux/scala/build-from-source.md %}{% endmarkdown %} - -{% markdown %}{% include /get_started/linux/clojure/build-from-source.md %}{% endmarkdown %} - +{% markdown %}{% include /get_started/linux/clojure/build-from-source.md %}{% endmarkdown %} - -{% markdown %}{% include /get_started/linux/java/build-from-source.md %}{% endmarkdown %} - +{% markdown %}{% include /get_started/linux/java/build-from-source.md %}{% endmarkdown %} - -{% markdown %}{% include /get_started/linux/julia/build-from-source.md %}{% endmarkdown %} - +{% markdown %}{% include /get_started/linux/julia/build-from-source.md %}{% endmarkdown %} - -{% markdown %}{% include /get_started/linux/perl/build-from-source.md %}{% endmarkdown %} - +{% markdown %}{% include /get_started/linux/perl/build-from-source.md %}{% endmarkdown %} - -{% markdown %}{% include /get_started/linux/cpp/build-from-source.md %}{% endmarkdown %} - +{% markdown %}{% include /get_started/linux/cpp/build-from-source.md %}{% endmarkdown %} @@ -276,48 +245,34 @@ - -{% markdown %}{% include /get_started/macos/r/build-from-source.md %}{% endmarkdown %} - +{% markdown %}{% include /get_started/macos/r/build-from-source.md %}{% endmarkdown %} - -{% markdown %}{% include /get_started/macos/scala/build-from-source.md %}{% endmarkdown %} - +{% markdown %}{% include /get_started/macos/scala/build-from-source.md %}{% endmarkdown %} - -{% markdown %}{% include /get_started/macos/clojure/build-from-source.md %}{% endmarkdown %} - +{% markdown %}{% include
[GitHub] [incubator-mxnet] leezu merged pull request #18661: fix broken installation widget - remove empty entries for better UX
leezu merged pull request #18661: URL: https://github.com/apache/incubator-mxnet/pull/18661 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [incubator-mxnet] nikudyshko opened a new issue #18668: InferArgsMap does not infer dtype
nikudyshko opened a new issue #18668: URL: https://github.com/apache/incubator-mxnet/issues/18668 ## Description While creating a neural network with MXNet cpp-api, if set `dtype` of know args to `1 (corresponds float64)`, `InferArgsMap` will not transfer this type to infered args. This causes error, when creating Executor. ### Error Message [22:30:58] C:\Users\UserName\Desktop\neural_nets\Mark1\Mark1\mxnet\include\dmlc\logging.h:429: [22:30:58] C:\Users\UserName\Desktop\neural_nets\Mark1\Mark1\mxnet\include\mxnet-cpp\executor.hpp:85: Check failed: MXExecutorBindEX(symbol.GetHandle(), context.GetDeviceType(), context.GetDeviceId(), group_to_ctx.size(), map_keys.data(), dev_types.data(), dev_ids.data(), arg_handles.size(), arg_handles.data(), grad_handles.data(), grad_reqs_uint.data(), aux_handles.size(), aux_handles.data(), shared_exec_handle, _) == 0 (-1 vs. 0) : ## To Reproduce ```cpp #include #include "mxnet-cpp/MxNetCpp.h" using namespace mxnet::cpp; Symbol mlp(const std::vector& layers) { auto x = Symbol::Variable("X"); auto label = Symbol::Variable("label"); std::vector weights(layers.size()); std::vector biases(layers.size()); std::vector outputs(layers.size()); for (size_t i = 0; i < layers.size(); ++i) { weights[i] = Symbol::Variable("w" + std::to_string(i)); biases[i] = Symbol::Variable("b" + std::to_string(i)); Symbol fc = FullyConnected( i == 0 ? x : outputs[i - 1], // data weights[i], biases[i], layers[i]); outputs[i] = i == layers.size() - 1 ? fc : Activation(fc, ActivationActType::kRelu); } return SoftmaxOutput(outputs.back(), label); } int main() { const int image_size = 28; const std::vector layers{ 128, 64, 10 }; const int batch_size = 100; const int max_epoch = 10; const float learning_rate = 0.1; const float weight_decay = 1e-2; auto net = mlp(layers); Context ctx = Context::cpu(); // Use CPU for training std::map args; args["X"] = NDArray(Shape(batch_size, image_size * image_size), ctx, true, 1); // 1 should correspond to float64 args["label"] = NDArray(Shape(batch_size), ctx, true, 1); // 1 should correspond to float64 // Let MXNet infer shapes other parameters such as weights net.InferArgsMap(ctx, , args); for (auto& arg : args) std::cout << arg.first << ' ' << arg.second.GetDType() << '\n'; // Output here: // X 1 // b0 0 // b1 0 // b2 0 // label 1 // w0 0 // w1 0 // w2 0 // All 0 should be 1 // Create executor by binding parameters to the model auto* exec = net.SimpleBind(ctx, args); // Error here return 0; } ``` ### Steps to reproduce Just compile and run the code above ## What have you tried to solve it? I've tried to add `dtype`-infering to the code of `InferArgsMap`. This allowed me to create a network, but than an had been thrown on args destruction. ## Environment Win10 64-bit, VS2019, MXNet This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [incubator-mxnet] andrei5055 edited a comment on pull request #18582: Refactoring of Pooled Storage Manager classes
andrei5055 edited a comment on pull request #18582: URL: https://github.com/apache/incubator-mxnet/pull/18582#issuecomment-654937596 **Please, for now ignore graphs for CPU and CPU_PINNED memory. I am not sure why, but I don't see 2x run time improvement for newly implemented Pooled Storage Managers with respect to "Unpooled" ones, which I saw on my local NVidia branch. Perhaps, it's because I was using my workstation with limited amount of CPU memory. I will try to run the same benchmarks on the machine with more CPU memory and I will update the results.** ![image](https://user-images.githubusercontent.com/7293680/86802902-55de1a80-c02a-11ea-9c0c-b8aa6c7d9089.png) (Here we do have only three lines, because the Pooled Storage Manager was not implemented for CPU_PINNED memory.) This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [incubator-mxnet] andrei5055 edited a comment on pull request #18582: Refactoring of Pooled Storage Manager classes
andrei5055 edited a comment on pull request #18582: URL: https://github.com/apache/incubator-mxnet/pull/18582#issuecomment-654937596 **Please, for now ignore graphs for CPU and CPU_PINNED memory. I am not sure why, but I don't see 2x run time improvement for newly implemented Pooled Storage Managers with respect to "Unpooled" ones. Perhaps, it's because I was using my workstation with limited amount of CPU memory. I will try to run the same benchmarks on the machine with more CPU memory and I will update the results.** ![image](https://user-images.githubusercontent.com/7293680/86802902-55de1a80-c02a-11ea-9c0c-b8aa6c7d9089.png) (Here we do have only three lines, because the Pooled Storage Manager was not implemented for CPU_PINNED memory.) This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [incubator-mxnet] andrei5055 edited a comment on pull request #18582: Refactoring of Pooled Storage Manager classes
andrei5055 edited a comment on pull request #18582: URL: https://github.com/apache/incubator-mxnet/pull/18582#issuecomment-654562254 Here is first graph for GPU Storage Managers: ![image](https://user-images.githubusercontent.com/7293680/86691969-30b3c280-bfbe-11ea-9101-0e2ef18b2210.png) ![image](https://user-images.githubusercontent.com/7293680/86829495-53d78400-c049-11ea-9b2f-29d55f332a9d.png) I will construct similar graphs for CPU, CPU_PINNED and Threaded Engines. My benchmarks are based on [that script](https://github.com/apache/incubator-mxnet/issues/17335). As you could see, some lines are almost identical, as it should be. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[incubator-mxnet-site] branch asf-site updated: Bump the publish timestamp.
This is an automated email from the ASF dual-hosted git repository. aaronmarkham pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/incubator-mxnet-site.git The following commit(s) were added to refs/heads/asf-site by this push: new 3241a64 Bump the publish timestamp. 3241a64 is described below commit 3241a64f15b820371b34bf0c030f82a7973bd738 Author: mxnet-ci AuthorDate: Tue Jul 7 18:41:11 2020 + Bump the publish timestamp. --- date.txt | 1 + 1 file changed, 1 insertion(+) diff --git a/date.txt b/date.txt new file mode 100644 index 000..be409e3 --- /dev/null +++ b/date.txt @@ -0,0 +1 @@ +Tue Jul 7 18:41:11 UTC 2020
[GitHub] [incubator-mxnet] szha commented on a change in pull request #18582: Refactoring of Pooled Storage Manager classes
szha commented on a change in pull request #18582: URL: https://github.com/apache/incubator-mxnet/pull/18582#discussion_r451039888 ## File path: src/storage/cpu_device_storage.h ## @@ -63,15 +60,12 @@ class CPUDeviceStorage { }; // class CPUDeviceStorage inline void CPUDeviceStorage::Alloc(Storage::Handle* handle) { - handle->dptr = nullptr; - const size_t size = handle->size; - if (size == 0) return; - + // NOTE: handle->size is NOT 0. See calling method: StorageImpl::Alloc Review comment: remove the comment as it doesn't help future reader of the code. if needed, document the invariant in interface definition instead. same for other occurrences. ## File path: src/storage/pooled_storage_manager.h ## @@ -25,372 +25,420 @@ #ifndef MXNET_STORAGE_POOLED_STORAGE_MANAGER_H_ #define MXNET_STORAGE_POOLED_STORAGE_MANAGER_H_ -#if MXNET_USE_CUDA - #include -#endif // MXNET_USE_CUDA - -#include -#include -#include -#include +#include #include +#include #include -#include +#include #include "./storage_manager.h" -#include "../common/cuda_utils.h" -#include "../common/utils.h" #include "../profiler/storage_profiler.h" namespace mxnet { namespace storage { +typedef enum { + pool_type, + pool_page_size, + large_alloc_size, + round_linear_cutoff, + pool_reserve, +} env_var_type; + +const std::string env_var_name(const char* dev_type, env_var_type type); + #if MXNET_USE_CUDA +#define SET_DEVICE(device_store, contextHelper, ctx, flag) \ + const auto *device_store = flag? contextHelper.get()->SetCurrentDevice(ctx) : nullptr; +#define UNSET_DEVICE(device_store)delete device_store + +#define SET_GPU_PROFILER(prof, contextHelper) \ + auto prof = contextHelper->contextGPU()? \ + profiler::GpuDeviceStorageProfiler::Get() : nullptr; \ + if (!prof->IsProfiling()) prof = nullptr + +#define GPU_PROFILER_ON_FREE(prof, pntr)if (prof) prof->OnFree(pntr) +#else +// empty macros when MxNet is compile without CUDA support +#define SET_DEVICE(...) +#define UNSET_DEVICE(...) +#define SET_GPU_PROFILER(prof, ...) +#define GPU_PROFILER_ON_FREE(prof, ...) +#endif + /*! - * \brief Storage manager with a memory pool on gpu. Memory chunks are reused based on exact size - * match. + * \brief Storage manager with a memory pool for GPU/CPU/CPUPunned memory chunks + * memory chunks which reused based on rounded size match. + * Rounding method is defined by the template parameter BucketingStrategy. + * Memory pool type is defined by the template parameter StoringMethod + * Allocation/freeing of memory is done by contextHelper_, which is the pointer + * to one of memory specific instance of the class, derived from ContextHelper */ -class GPUPooledStorageManager final : public StorageManager { +template +class PooledStorageManager : public StorageManager, + public BucketingStrategy, public StoringMethod { public: - /*! - * \brief Default constructor. - * - * \param initial_context context used by this Storage Manager - */ - explicit GPUPooledStorageManager(Context initial_context) : -initial_context_(initial_context) { -reserve_ = dmlc::GetEnv("MXNET_GPU_MEM_POOL_RESERVE", 5); -page_size_ = dmlc::GetEnv("MXNET_GPU_MEM_POOL_PAGE_SIZE", 4096); -large_alloc_round_size_ = dmlc::GetEnv("MXNET_GPU_MEM_LARGE_ALLOC_ROUND_SIZE", 2 * 1024 * 1024); -if (large_alloc_round_size_ <= 0) { - LOG(FATAL) << "MXNET_GPU_MEM_LARGE_ALLOC_ROUND_SIZE cannot be set to a value <= 0, found: " - << large_alloc_round_size_; + explicit PooledStorageManager(const Context , int num_gpu_device) { +const char *dev_type = nullptr; +switch (dev_type_ = ctx.dev_type) { +#if MXNET_USE_CUDA + case Context::kGPU: contextHelper_ = std::make_unique(); +dev_type = "GPU"; +break; + case Context::kCPUPinned: dev_type = "CPU_PINNED"; +if (num_gpu_device > 1) { + contextHelper_ = std::make_unique(); + dev_type_ = Context::kGPU; + break; +} +#else + case Context::kCPUPinned: dev_type = "CPU_PINNED"; +#endif +dev_type_ = Context::kCPU; + case Context::kCPU: contextHelper_ = std::make_unique(); +dev_type = "CPU"; + default: break; } -if (page_size_ < NDEV) { - LOG(FATAL) << "MXNET_GPU_MEM_POOL_PAGE_SIZE cannot be set to a value smaller than " << NDEV \ - << ". Got " << page_size_ << "."; + +BucketingStrategy::InitRoundHelper(dev_type); +StoringMethod::InitContainer(this); +contextHelper_->set_initilal_context(ctx); + +// percentage of reserved memory +if
[GitHub] [incubator-mxnet] leezu commented on issue #18667: Error: include/mxnet/./tuple.h:354: Check failed: ndim >= -1
leezu commented on issue #18667: URL: https://github.com/apache/incubator-mxnet/issues/18667#issuecomment-655028589 The Intel x86 and AMD64 / x86-64 series of processors use the little-endian format whereas s390x architecture uses big-endian format. Current MXNet parameter serialization format is just a memory dump and can't be loaded on a system with different endianness. For MXNet 2, we're switching to using the numpy serialization format which will prevent such issues (https://numpy.org/devdocs/reference/generated/numpy.lib.format.html) For now, you can't use the pretrained models directly on s390x architecture but you'd need some workaround where you load the parameter on a x86 machine, call `asnumpy`, save via numpy and finally load the parameters on s390x machine using numpy and convert them to mxnet. Would that work for you? This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[incubator-mxnet] branch master updated (54c0155 -> b4b8b80)
This is an automated email from the ASF dual-hosted git repository. zhasheng pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/incubator-mxnet.git. from 54c0155 User Feedback Widget (#18639) add b4b8b80 Gluon.probability (#18403) No new revisions were added by this update. Summary of changes: python/mxnet/gluon/__init__.py |2 + .../mxnet/gluon/probability}/__init__.py |7 +- .../mxnet/gluon/probability/block}/__init__.py |5 +- .../gluon/probability/block/stochastic_block.py| 134 ++ .../gluon/probability/distributions/__init__.py| 86 + .../gluon/probability/distributions/bernoulli.py | 139 ++ .../mxnet/gluon/probability/distributions/beta.py | 97 + .../gluon/probability/distributions/binomial.py| 145 ++ .../gluon/probability/distributions/categorical.py | 168 ++ .../gluon/probability/distributions/cauchy.py | 96 + .../distributions/chi2.py} | 38 +- .../gluon/probability/distributions/constraint.py | 548 + .../gluon/probability/distributions/dirichlet.py | 102 + .../probability/distributions/distribution.py | 198 ++ .../gluon/probability/distributions/divergence.py | 382 +++ .../gluon/probability/distributions/exp_family.py | 68 + .../gluon/probability/distributions/exponential.py | 110 + .../probability/distributions/fishersnedecor.py| 107 + .../mxnet/gluon/probability/distributions/gamma.py | 102 + .../gluon/probability/distributions/geometric.py | 133 ++ .../gluon/probability/distributions/gumbel.py | 109 + .../gluon/probability/distributions/half_cauchy.py | 81 + .../gluon/probability/distributions/half_normal.py | 82 + .../gluon/probability/distributions/independent.py | 94 + .../gluon/probability/distributions/laplace.py | 143 ++ .../gluon/probability/distributions/multinomial.py | 125 + .../distributions/multivariate_normal.py | 174 ++ .../probability/distributions/negative_binomial.py | 140 ++ .../gluon/probability/distributions/normal.py | 166 ++ .../distributions/one_hot_categorical.py | 105 + .../gluon/probability/distributions/pareto.py | 83 + .../gluon/probability/distributions/poisson.py | 110 + .../probability/distributions/relaxed_bernoulli.py | 138 ++ .../distributions/relaxed_one_hot_categorical.py | 177 ++ .../gluon/probability/distributions/studentT.py| 119 + .../distributions/transformed_distribution.py | 105 + .../gluon/probability/distributions/uniform.py | 101 + .../mxnet/gluon/probability/distributions/utils.py | 202 ++ .../gluon/probability/distributions/weibull.py | 85 + .../transformation}/__init__.py|7 +- .../gluon/probability/transformation/domain_map.py | 123 + .../probability/transformation/transformation.py | 305 +++ python/mxnet/ndarray/numpy_extension/random.py |2 +- src/operator/random/multisample_op.cc | 17 +- src/operator/random/multisample_op.h |6 +- src/operator/random/sample_op.cc |1 + tests/python/gpu/test_operator_gpu.py |2 + tests/python/unittest/test_gluon_probability_v1.py | 2435 tests/python/unittest/test_gluon_probability_v2.py | 2365 +++ 49 files changed, 10233 insertions(+), 36 deletions(-) copy {plugin/opencv => python/mxnet/gluon/probability}/__init__.py (88%) copy {plugin/opencv => python/mxnet/gluon/probability/block}/__init__.py (93%) create mode 100644 python/mxnet/gluon/probability/block/stochastic_block.py create mode 100644 python/mxnet/gluon/probability/distributions/__init__.py create mode 100644 python/mxnet/gluon/probability/distributions/bernoulli.py create mode 100644 python/mxnet/gluon/probability/distributions/beta.py create mode 100644 python/mxnet/gluon/probability/distributions/binomial.py create mode 100644 python/mxnet/gluon/probability/distributions/categorical.py create mode 100644 python/mxnet/gluon/probability/distributions/cauchy.py copy python/mxnet/gluon/{__init__.py => probability/distributions/chi2.py} (52%) create mode 100644 python/mxnet/gluon/probability/distributions/constraint.py create mode 100644 python/mxnet/gluon/probability/distributions/dirichlet.py create mode 100644 python/mxnet/gluon/probability/distributions/distribution.py create mode 100644 python/mxnet/gluon/probability/distributions/divergence.py create mode 100644 python/mxnet/gluon/probability/distributions/exp_family.py create mode 100644 python/mxnet/gluon/probability/distributions/exponential.py create mode 100644 python/mxnet/gluon/probability/distributions/fishersnedecor.py create mode 100644 python/mxnet/gluon/probability/distributions/gamma.py create mode 100644 python/mxnet/gluon/probability/distributions/geometric.py create mode 100644
[incubator-mxnet] branch master updated (54c0155 -> b4b8b80)
This is an automated email from the ASF dual-hosted git repository. zhasheng pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/incubator-mxnet.git. from 54c0155 User Feedback Widget (#18639) add b4b8b80 Gluon.probability (#18403) No new revisions were added by this update. Summary of changes: python/mxnet/gluon/__init__.py |2 + .../mxnet/gluon/probability}/__init__.py |7 +- .../mxnet/gluon/probability/block}/__init__.py |5 +- .../gluon/probability/block/stochastic_block.py| 134 ++ .../gluon/probability/distributions/__init__.py| 86 + .../gluon/probability/distributions/bernoulli.py | 139 ++ .../mxnet/gluon/probability/distributions/beta.py | 97 + .../gluon/probability/distributions/binomial.py| 145 ++ .../gluon/probability/distributions/categorical.py | 168 ++ .../gluon/probability/distributions/cauchy.py | 96 + .../distributions/chi2.py} | 38 +- .../gluon/probability/distributions/constraint.py | 548 + .../gluon/probability/distributions/dirichlet.py | 102 + .../probability/distributions/distribution.py | 198 ++ .../gluon/probability/distributions/divergence.py | 382 +++ .../gluon/probability/distributions/exp_family.py | 68 + .../gluon/probability/distributions/exponential.py | 110 + .../probability/distributions/fishersnedecor.py| 107 + .../mxnet/gluon/probability/distributions/gamma.py | 102 + .../gluon/probability/distributions/geometric.py | 133 ++ .../gluon/probability/distributions/gumbel.py | 109 + .../gluon/probability/distributions/half_cauchy.py | 81 + .../gluon/probability/distributions/half_normal.py | 82 + .../gluon/probability/distributions/independent.py | 94 + .../gluon/probability/distributions/laplace.py | 143 ++ .../gluon/probability/distributions/multinomial.py | 125 + .../distributions/multivariate_normal.py | 174 ++ .../probability/distributions/negative_binomial.py | 140 ++ .../gluon/probability/distributions/normal.py | 166 ++ .../distributions/one_hot_categorical.py | 105 + .../gluon/probability/distributions/pareto.py | 83 + .../gluon/probability/distributions/poisson.py | 110 + .../probability/distributions/relaxed_bernoulli.py | 138 ++ .../distributions/relaxed_one_hot_categorical.py | 177 ++ .../gluon/probability/distributions/studentT.py| 119 + .../distributions/transformed_distribution.py | 105 + .../gluon/probability/distributions/uniform.py | 101 + .../mxnet/gluon/probability/distributions/utils.py | 202 ++ .../gluon/probability/distributions/weibull.py | 85 + .../transformation}/__init__.py|7 +- .../gluon/probability/transformation/domain_map.py | 123 + .../probability/transformation/transformation.py | 305 +++ python/mxnet/ndarray/numpy_extension/random.py |2 +- src/operator/random/multisample_op.cc | 17 +- src/operator/random/multisample_op.h |6 +- src/operator/random/sample_op.cc |1 + tests/python/gpu/test_operator_gpu.py |2 + tests/python/unittest/test_gluon_probability_v1.py | 2435 tests/python/unittest/test_gluon_probability_v2.py | 2365 +++ 49 files changed, 10233 insertions(+), 36 deletions(-) copy {plugin/opencv => python/mxnet/gluon/probability}/__init__.py (88%) copy {plugin/opencv => python/mxnet/gluon/probability/block}/__init__.py (93%) create mode 100644 python/mxnet/gluon/probability/block/stochastic_block.py create mode 100644 python/mxnet/gluon/probability/distributions/__init__.py create mode 100644 python/mxnet/gluon/probability/distributions/bernoulli.py create mode 100644 python/mxnet/gluon/probability/distributions/beta.py create mode 100644 python/mxnet/gluon/probability/distributions/binomial.py create mode 100644 python/mxnet/gluon/probability/distributions/categorical.py create mode 100644 python/mxnet/gluon/probability/distributions/cauchy.py copy python/mxnet/gluon/{__init__.py => probability/distributions/chi2.py} (52%) create mode 100644 python/mxnet/gluon/probability/distributions/constraint.py create mode 100644 python/mxnet/gluon/probability/distributions/dirichlet.py create mode 100644 python/mxnet/gluon/probability/distributions/distribution.py create mode 100644 python/mxnet/gluon/probability/distributions/divergence.py create mode 100644 python/mxnet/gluon/probability/distributions/exp_family.py create mode 100644 python/mxnet/gluon/probability/distributions/exponential.py create mode 100644 python/mxnet/gluon/probability/distributions/fishersnedecor.py create mode 100644 python/mxnet/gluon/probability/distributions/gamma.py create mode 100644 python/mxnet/gluon/probability/distributions/geometric.py create mode 100644
[GitHub] [incubator-mxnet] szha merged pull request #18403: Gluon.probability
szha merged pull request #18403: URL: https://github.com/apache/incubator-mxnet/pull/18403 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [incubator-mxnet] ys2843 edited a comment on pull request #18664: Fix python micro-site table of content bugs
ys2843 edited a comment on pull request #18664: URL: https://github.com/apache/incubator-mxnet/pull/18664#issuecomment-653923786 @mxnet-label-bot add [Website] This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [incubator-mxnet] i55code commented on issue #18657: MXNET for cuda 11.0 Nvidia 450
i55code commented on issue #18657: URL: https://github.com/apache/incubator-mxnet/issues/18657#issuecomment-654954107 Thank you @DickJC123 ! This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [incubator-mxnet] andrei5055 commented on pull request #18582: Refactoring of Pooled Storage Manager classes
andrei5055 commented on pull request #18582: URL: https://github.com/apache/incubator-mxnet/pull/18582#issuecomment-654943614 ![image](https://user-images.githubusercontent.com/7293680/86804698-fda81800-c02b-11ea-92d0-29b6bfc6ad46.png) (Here we do have only three lines, because the Pooled Storage Manager was not implemented for CPU memory.) This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [incubator-mxnet] andrei5055 commented on pull request #18582: Refactoring of Pooled Storage Manager classes
andrei5055 commented on pull request #18582: URL: https://github.com/apache/incubator-mxnet/pull/18582#issuecomment-654937596 ![image](https://user-images.githubusercontent.com/7293680/86802902-55de1a80-c02a-11ea-9c0c-b8aa6c7d9089.png) (Here we do have only three lines, because the Pooled Storage Manager was not implemented for CPU_PINNED memory.) This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [incubator-mxnet] Masquerade0097 opened a new issue #18667: include/mxnet/./tuple.h:354: Check failed: ndim >= -1
Masquerade0097 opened a new issue #18667: URL: https://github.com/apache/incubator-mxnet/issues/18667 ## Description I'm working on enabling MXNet on IBM Z (s390x architecture) machines. I successfully installed MXNet on s390x but encountered the following error while trying to use it. ### Error Message ``` Traceback (most recent call last): File "scr.py", line 76, in finetune_net = resnet50_v2(pretrained=True, ctx=ctx) File "/root/mxnet-1.5.0/mxnet/python/mxnet/gluon/model_zoo/vision/resnet.py", line 512, in resnet50_v2 return get_resnet(2, 50, **kwargs) File "/root/mxnet-1.5.0/mxnet/python/mxnet/gluon/model_zoo/vision/resnet.py", line 391, in get_resnet root=root), ctx=ctx) File "/root/mxnet-1.5.0/mxnet/python/mxnet/gluon/block.py", line 384, in load_parameters loaded = ndarray.load(filename) File "/root/mxnet-1.5.0/mxnet/python/mxnet/ndarray/utils.py", line 175, in load ctypes.byref(names))) File "/root/mxnet-1.5.0/mxnet/python/mxnet/base.py", line 253, in check_call raise MXNetError(py_str(_LIB.MXGetLastError())) mxnet.base.MXNetError: [19:50:04] include/mxnet/./tuple.h:354: Check failed: ndim >= -1 (-906324999 vs. -1) : ndim cannot be less than -1, received -906324999 Stack trace: [bt] (0) /opt/mxnet/lib/libmxnet.so(mxnet::Tuple::SetDim(int)+0x670) [0x3ff841f6888] [bt] (1) /opt/mxnet/lib/libmxnet.so(mxnet::TShape::TShape(int, long)+0x2a) [0x3ff841f6d12] [bt] (2) /opt/mxnet/lib/libmxnet.so(mxnet::LegacyTShapeLoad(dmlc::Stream*, mxnet::TShape*, unsigned int)+0x4e) [0x3ff8629f0be] [bt] (3) /opt/mxnet/lib/libmxnet.so(mxnet::NDArray::LegacyLoad(dmlc::Stream*, unsigned int)+0x68) [0x3ff862a4578] [bt] (4) /opt/mxnet/lib/libmxnet.so(mxnet::NDArray::Load(dmlc::Stream*)+0x12e) [0x3ff862a91de] [bt] (5) /opt/mxnet/lib/libmxnet.so(mxnet::NDArray::Load(dmlc::Stream*, std::vector >*, std::vector, std::allocator >, std::allocator, std::allocator > > >*)+0x8b8) [0x3ff862ac4d8] [bt] (6) /opt/mxnet/lib/libmxnet.so(MXNDArrayLoad+0xf4) [0x3ff8692eaa4] [bt] (7) /usr/lib/s390x-linux-gnu/libffi.so.6(ffi_call_SYSV+0x98) [0x3ff88385760] [bt] (8) /usr/lib/s390x-linux-gnu/libffi.so.6(ffi_call+0x72) [0x3ff88385e12] ``` ## To Reproduce 1. Install MXNet from source with the flag `USE_SSE=0`. 2. Follow the tutorial to test the library - https://mxnet.apache.org/api/python/docs/tutorials/getting-started/gluon_from_experiment_to_deployment.html ## Environment ``` --Python Info-- ('Version :', '2.7.17') ('Compiler :', 'GCC 7.5.0') ('Build:', ('default', 'Apr 15 2020 17:20:14')) ('Arch :', ('64bit', '')) Pip Info--- ('Version :', '9.0.1') ('Directory:', '/usr/lib/python2.7/dist-packages/pip') --MXNet Info--- No MXNet installed. --System Info-- ('Platform :', 'Linux-4.15.0-99-generic-s390x-with-Ubuntu-18.04-bionic') ('system :', 'Linux') ('node :', 'e0e720e9a63c') ('release :', '4.15.0-99-generic') ('version :', '#100-Ubuntu SMP Wed Apr 22 20:31:47 UTC 2020') --Hardware Info-- ('machine :', 's390x') ('processor:', 's390x') Architecture:s390x CPU op-mode(s): 32-bit, 64-bit Byte Order: Big Endian CPU(s): 4 On-line CPU(s) list: 0-3 Thread(s) per core: 1 Core(s) per socket: 1 Socket(s) per book: 1 Book(s) per drawer: 1 Drawer(s): 4 NUMA node(s):1 Vendor ID: IBM/S390 Machine type:3906 CPU dynamic MHz: 5208 CPU static MHz: 5208 BogoMIPS:21881.00 Hypervisor: z/VM 7.1.0 Hypervisor vendor: IBM Virtualization type: full Dispatching mode:horizontal L1d cache: 128K L1i cache: 128K L2d cache: 4096K L2i cache: 2048K L3 cache:131072K L4 cache:688128K NUMA node0 CPU(s): 0-3 Flags: esan3 zarch stfle msa ldisp eimm dfp edat etf3eh highgprs te vx vxd vxe gs sie --Network Test-- Setting timeout: 10 Timing for PYPI: https://pypi.python.org/pypi/pip, DNS: 0.0296 sec, LOAD: 0.5045 sec. Timing for D2L: http://d2l.ai, DNS: 0.0213 sec, LOAD: 0.0491 sec. Timing for FashionMNIST: https://repo.mxnet.io/gluon/dataset/fashion-mnist/train-labels-idx1-ubyte.gz, DNS: 0.0572 sec, LOAD: 0.4216 sec. Error open Conda: https://repo.continuum.io/pkgs/free/, HTTP Error 403: Forbidden, DNS finished in 0.0146398544312 sec. Timing for MXNet: https://github.com/apache/incubator-mxnet, DNS: 0.0226 sec, LOAD: 0.5108 sec. Timing for GluonNLP: http://gluon-nlp.mxnet.io, DNS: 0.0651 sec, LOAD: 0.3567 sec. Timing for D2L (zh-cn): http://zh.d2l.ai, DNS:
[incubator-mxnet-site] branch asf-site updated: Publish triggered by CI
This is an automated email from the ASF dual-hosted git repository. aaronmarkham pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/incubator-mxnet-site.git The following commit(s) were added to refs/heads/asf-site by this push: new 1b9e553 Publish triggered by CI 1b9e553 is described below commit 1b9e5535550cabd48454ce96f9432b21bc818a4b Author: mxnet-ci AuthorDate: Tue Jul 7 12:40:21 2020 + Publish triggered by CI --- date.txt | 1 - feed.xml | 2 +- 2 files changed, 1 insertion(+), 2 deletions(-) diff --git a/date.txt b/date.txt deleted file mode 100644 index 89b5824..000 --- a/date.txt +++ /dev/null @@ -1 +0,0 @@ -Tue Jul 7 06:41:41 UTC 2020 diff --git a/feed.xml b/feed.xml index 383b781..4e94550 100644 --- a/feed.xml +++ b/feed.xml @@ -1 +1 @@ -http://www.w3.org/2005/Atom; >https://jekyllrb.com/; version="4.0.0">Jekyllhttps://mxnet.apache.org/feed.xml; rel="self" type="application/atom+xml" />https://mxnet.apache.org/; rel="alternate" type="text/html" />2020-07-07T06:30:40+00:00https://mxnet.apache.org/feed.xmlApache MXNetA flexible and efficient library for deep [...] \ No newline at end of file +http://www.w3.org/2005/Atom; >https://jekyllrb.com/; version="4.0.0">Jekyllhttps://mxnet.apache.org/feed.xml; rel="self" type="application/atom+xml" />https://mxnet.apache.org/; rel="alternate" type="text/html" />2020-07-07T12:29:56+00:00https://mxnet.apache.org/feed.xmlApache MXNetA flexible and efficient library for deep [...] \ No newline at end of file
[incubator-mxnet-site] branch asf-site updated: Bump the publish timestamp.
This is an automated email from the ASF dual-hosted git repository. aaronmarkham pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/incubator-mxnet-site.git The following commit(s) were added to refs/heads/asf-site by this push: new 946344c Bump the publish timestamp. 946344c is described below commit 946344c6619be9d7d52bd719cb21db0b12bd6002 Author: mxnet-ci AuthorDate: Tue Jul 7 12:40:33 2020 + Bump the publish timestamp. --- date.txt | 1 + 1 file changed, 1 insertion(+) diff --git a/date.txt b/date.txt new file mode 100644 index 000..c94f28d --- /dev/null +++ b/date.txt @@ -0,0 +1 @@ +Tue Jul 7 12:40:33 UTC 2020
[GitHub] [incubator-mxnet] chinakook commented on pull request #18055: Implement some ONNX exports, needed for SSD
chinakook commented on pull request #18055: URL: https://github.com/apache/incubator-mxnet/pull/18055#issuecomment-654823984 It's a great job! This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [incubator-mxnet] RuRo commented on pull request #18055: Implement some ONNX exports, needed for SSD
RuRo commented on pull request #18055: URL: https://github.com/apache/incubator-mxnet/pull/18055#issuecomment-654778673 @VisionZQ This PR currently has WIP status (it's not ready) and it's main purpose was to implement the needed ops to convert `SSD` models from `mxnet` to `ONNX`. There's been a lot of breakage recently with `onnx2mx`, so some further work may be required. I am not sure, I can help you with converting `yolov3`. I don't currently have the free time to even finish this PR. I would recommend, that you open an issue, describing, which layers needed for `yolov3` don't have a conversion in `mxnet 1.6.0` and which conversion functions are currently missing in `mxnet 2.0.0`, but I wouldn't get your hopes up, that somebody will implement the conversions for you. Afaik, most `mxnet` contributors are currently **very** busy with `mxnet 2` API changes. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [incubator-mxnet] fhieber commented on issue #18662: out of memory issue while using mxnet with sockeye
fhieber commented on issue #18662: URL: https://github.com/apache/incubator-mxnet/issues/18662#issuecomment-654711227 Lowering the batch size should definitely allow you to train a model. You could also try lowering the size of the model `--transformer-model-size` and `--num-embed`, or reduce the number of layers `--num-layers`. I am also not sure whether your output of `pip3 list | grep mxnet` isn't concerning. To my knowledge it is not advisable to have 3 different versions of MXNet installed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [incubator-mxnet] VisionZQ commented on pull request #18055: Implement some ONNX exports, needed for SSD
VisionZQ commented on pull request #18055: URL: https://github.com/apache/incubator-mxnet/pull/18055#issuecomment-654706877 Hi, Thanks for you kindness. We have converted the mxnet to onnx 1.5, and the 'slice_like' is work. But, When I from onnx convert to TensorRT6.0, the program crash. can you give me any suggestion? `While parsing node number 205 [Gather -> "yolov30__mulscalar0__shape__gathered"]: ERROR: /home/jakin/songzq/onnx-tensorrt/onnx2trt_utils.hpp:412 In function convert_axis: [8] Assertion failed: axis >= 0 && axis < nbDims ` Thanks a lot. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [incubator-mxnet] tranvanhoa533 commented on issue #18659: Accumulated gradient with module symbolic api not work
tranvanhoa533 commented on issue #18659: URL: https://github.com/apache/incubator-mxnet/issues/18659#issuecomment-654648681 Thanks @leezu . It seems very complicated. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[incubator-mxnet-site] branch asf-site updated: Bump the publish timestamp.
This is an automated email from the ASF dual-hosted git repository. aaronmarkham pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/incubator-mxnet-site.git The following commit(s) were added to refs/heads/asf-site by this push: new f02c7e9 Bump the publish timestamp. f02c7e9 is described below commit f02c7e98c391c8adaa68e9e89cddc6d03fd65371 Author: mxnet-ci AuthorDate: Tue Jul 7 06:41:41 2020 + Bump the publish timestamp. --- date.txt | 1 + 1 file changed, 1 insertion(+) diff --git a/date.txt b/date.txt new file mode 100644 index 000..89b5824 --- /dev/null +++ b/date.txt @@ -0,0 +1 @@ +Tue Jul 7 06:41:41 UTC 2020
[incubator-mxnet-site] branch asf-site updated: Publish triggered by CI
This is an automated email from the ASF dual-hosted git repository. aaronmarkham pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/incubator-mxnet-site.git The following commit(s) were added to refs/heads/asf-site by this push: new 087091d Publish triggered by CI 087091d is described below commit 087091df90df1cdbe8a74ea7ec158cad0cb7900a Author: mxnet-ci AuthorDate: Tue Jul 7 06:41:31 2020 + Publish triggered by CI --- date.txt | 1 - feed.xml | 2 +- 2 files changed, 1 insertion(+), 2 deletions(-) diff --git a/date.txt b/date.txt deleted file mode 100644 index 286c0ba..000 --- a/date.txt +++ /dev/null @@ -1 +0,0 @@ -Tue Jul 7 00:50:32 UTC 2020 diff --git a/feed.xml b/feed.xml index 5aa8fc0..383b781 100644 --- a/feed.xml +++ b/feed.xml @@ -1 +1 @@ -http://www.w3.org/2005/Atom; >https://jekyllrb.com/; version="4.0.0">Jekyllhttps://mxnet.apache.org/feed.xml; rel="self" type="application/atom+xml" />https://mxnet.apache.org/; rel="alternate" type="text/html" />2020-07-07T00:37:35+00:00https://mxnet.apache.org/feed.xmlApache MXNetA flexible and efficient library for deep [...] \ No newline at end of file +http://www.w3.org/2005/Atom; >https://jekyllrb.com/; version="4.0.0">Jekyllhttps://mxnet.apache.org/feed.xml; rel="self" type="application/atom+xml" />https://mxnet.apache.org/; rel="alternate" type="text/html" />2020-07-07T06:30:40+00:00https://mxnet.apache.org/feed.xmlApache MXNetA flexible and efficient library for deep [...] \ No newline at end of file
[GitHub] [incubator-mxnet] xidulu commented on pull request #18403: Gluon.probability
xidulu commented on pull request #18403: URL: https://github.com/apache/incubator-mxnet/pull/18403#issuecomment-654627013 @szha Could you help merge this PR? This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org