>
> > > I'm aware that we do not support this type of behaviour out of the box,
> > but
> > > I think that we're getting to a point where we should take a step back
> > and
> > > reconsider the approaches we would like to do in such resource-heavy
> >
otherwise we'd notice in quite a few other cases.
> >
> > Best regards,
> > Marco
> >
> > On Sat, May 25, 2019 at 12:15 PM Lv, Tao A wrote:
> >
> > > Hi Lin,
> > >
> > > Yes, MKL supports that. Please refer to
> > >
> https:/
eveloper-guide-using-the-ilp64-interface-vs-lp64-interface
> > for details.
> >
> > I also did some work towards that direction. Please see below PRs for
> > MXNet and mshadow respectively.
> > https://github.com/apache/incubator-mxnet/pull/13723
> > https://g
com/apache/incubator-mxnet/pull/13723
> https://github.com/dmlc/mshadow/pull/365
>
> Feel free to let me know if anything I can help.
>
> Thanks,
> -tao
>
>
> -Original Message-
> From: Lin Yuan [mailto:apefor...@gmail.com]
> Sent: Saturday, May 25, 2019 1:36 AM
>
...@mxnet.apache.org
Subject: Re: [RFC] Support for creation of Large Tensors in MXNet
Hi Sheng,
Thanks for the nice suggestions. To summarize the current status and future
plan of this project:
There were some missing operators from #11742 that did not support large
tensors. Thanbks to Rohit's
to support that.
> >
> > Thanks,
> > -tao
> >
> > -Original Message-
> > From: Srivastava, Rohit Kumar [mailto:
> srivastava@buckeyemail.osu.edu]
> > Sent: Sunday, May 19, 2019 7:23 AM
> > To: dev@mxnet.incubator.apache.o
be released at the middle of year. But I'm not sure if
> MXNet has plan to support that.
>
> Thanks,
> -tao
>
> -Original Message-
> From: Srivastava, Rohit Kumar [mailto:srivastava@buckeyemail.osu.edu]
> Sent: Sunday, May 19, 201
7:23 AM
To: dev@mxnet.incubator.apache.org
Subject: Re: [RFC] Support for creation of Large Tensors in MXNet
Hi Tao,
There are already couple of operators implemented in MXNet that are
currently supporting Tensors with size over ~4.5 billion. In the meantime core
MXNet
019 7:23 AM
To: dev@mxnet.incubator.apache.org
Subject: Re: [RFC] Support for creation of Large Tensors in MXNet
Hi Tao,
There are already couple of operators implemented in MXNet that are
currently supporting Tensors with size over ~4.5 billion. In the meantime core
MXNet can move ahead
Subject: Re: [RFC] Support for creation of Large Tensors in MXNet
Tao,
- what's the max size of dimensionality? Which data type is used to define
dimensionality (ndims)?
We assume the max size of dimensionality is relatively small. Hence `int`
data type is
pefor...@gmail.com]
Sent: Tuesday, April 30, 2019 12:56 AM
To: dev@mxnet.incubator.apache.org
Subject: Re: [RFC] Support for creation of Large Tensors in MXNet
Tao,
- what's the max size of dimensionality? Which data type is used to define
dimensionality (ndims)?
We assume the max size of dimensi
ese three can be *large*.
>
> -Original Message-
> From: Srivastava, Rohit Kumar [mailto:srivastava@buckeyemail.osu.edu]
> Sent: Saturday, April 27, 2019 7:33 AM
> To: dev@mxnet.incubator.apache.org
> Subject: [RFC] Support for creation of Large Tensors in MXNet
>
>
7:33 AM
To: dev@mxnet.incubator.apache.org
Subject: [RFC] Support for creation of Large Tensors in MXNet
Dear Community,
Currently MXNet supports creation of Tensors containing up to 2^32 elements.
However there are cases where tensors of size over 5 billion is required
We plan to support creation o
Dear Community,
Currently MXNet supports creation of Tensors containing up to 2^32 elements.
However there are cases where tensors of size over 5 billion is required
We plan to support creation of large tensors on MXNet. A design proposal is
ready for review:
https://cwiki.apache.org/confluence
14 matches
Mail list logo
