piiswrong commented on a change in pull request #9986: gluon language modeling
dataset and text token reader
URL: https://github.com/apache/incubator-mxnet/pull/9986#discussion_r172327467
##
File path: python/mxnet/gluon/data/datareader.py
##
@@ -0,0 +1,33 @@
+# Licensed t
piiswrong commented on a change in pull request #9986: gluon language modeling
dataset and text token reader
URL: https://github.com/apache/incubator-mxnet/pull/9986#discussion_r172284803
##
File path: python/mxnet/gluon/data/text/__init__.py
##
@@ -0,0 +1,24 @@
+# License
piiswrong commented on a change in pull request #9986: gluon language modeling
dataset and text token reader
URL: https://github.com/apache/incubator-mxnet/pull/9986#discussion_r172284891
##
File path: python/mxnet/gluon/data/text/_constants.py
##
@@ -0,0 +1,26 @@
+# Licen
piiswrong commented on a change in pull request #9986: gluon language modeling
dataset and text token reader
URL: https://github.com/apache/incubator-mxnet/pull/9986#discussion_r172285568
##
File path: python/mxnet/gluon/data/text/base.py
##
@@ -0,0 +1,89 @@
+# Licensed to
piiswrong commented on a change in pull request #9986: gluon language modeling
dataset and text token reader
URL: https://github.com/apache/incubator-mxnet/pull/9986#discussion_r172287707
##
File path: python/mxnet/gluon/utils.py
##
@@ -218,3 +220,25 @@ def download(url, p
piiswrong commented on a change in pull request #9986: gluon language modeling
dataset and text token reader
URL: https://github.com/apache/incubator-mxnet/pull/9986#discussion_r172285145
##
File path: python/mxnet/gluon/data/text/base.py
##
@@ -0,0 +1,89 @@
+# Licensed to
piiswrong commented on a change in pull request #9986: gluon language modeling
dataset and text token reader
URL: https://github.com/apache/incubator-mxnet/pull/9986#discussion_r172287751
##
File path: python/mxnet/gluon/utils.py
##
@@ -218,3 +220,25 @@ def download(url, p
piiswrong commented on a change in pull request #9986: gluon language modeling
dataset and text token reader
URL: https://github.com/apache/incubator-mxnet/pull/9986#discussion_r172287545
##
File path: python/mxnet/gluon/data/text/lm.py
##
@@ -0,0 +1,157 @@
+# Licensed to
piiswrong commented on a change in pull request #9986: gluon language modeling
dataset and text token reader
URL: https://github.com/apache/incubator-mxnet/pull/9986#discussion_r172284551
##
File path: python/mxnet/gluon/data/datareader.py
##
@@ -0,0 +1,33 @@
+# Licensed t