Hi Naveen
Great document. I spent some time understanding your proposal and I check
the linked talk on youtube from Boehm.
The topic is complex and the solution needs to be well thought, and seems
the document reflects that.
1- One thing that was not clear to me from the document is that, if
Thank you all for your feedback.
@Chris: Yes, One of the Amazon user(Calum Leslie) had contributed the
Dispose Pattern removing the free of native handles in Finalizers and
instead added Log. This was done because calling free in Finalizers was
segfaulting the application at random points and was
Naveen,
Thanks for putting together the detailed document and kickstarting this
effort. It will benefit all the MXNet JVM users and will help solve a
current pain point for them.
- Carin
On Tue, Sep 11, 2018 at 5:37 PM Naveen Swamy wrote:
> Hi All,
>
> I am working on managing Off-Heap Memory
Interesting and detailed document!
The JVM garbage collector gets executed depending on the memory pressure
for CPU RAM (or a different custom strategy). It was mentioned that this
document also supports disposing GPU objects. Sorry if I missed it, but how
exactly are we ensuring we don't run out
Thanks for great job!
My questions / proposals.
1) Have considered Java collections with low memory footprint like
Fastutil, Koloboke, etc.? They are much more memory efficient and they have
"better correspondence" with low level data types.
2) MNIST example on the page is "bad" because MNIST is
do you log on finalize() if the object wasn’t properly freed (ie
NDArray.finalize())? is that available in Scala?
On Tue, Sep 11, 2018 at 6:12 PM Qing Lan wrote:
> Nice document! Way better than current .dispose() in Scala!
>
> Thanks,
> Qing
>
> On 9/11/18, 6:04 PM, "Chris Olivier" wrote:
>
Nice document! Way better than current .dispose() in Scala!
Thanks,
Qing
On 9/11/18, 6:04 PM, "Chris Olivier" wrote:
wow, incredible document!
On Tue, Sep 11, 2018 at 2:37 PM Naveen Swamy wrote:
> Hi All,
>
> I am working on managing Off-Heap Memory Management
wow, incredible document!
On Tue, Sep 11, 2018 at 2:37 PM Naveen Swamy wrote:
> Hi All,
>
> I am working on managing Off-Heap Memory Management and have written a
> proposal here based on my prototype and research I did.
>
> Please review the doc and provide your feedback ?
>
>
Hi All,
I am working on managing Off-Heap Memory Management and have written a
proposal here based on my prototype and research I did.
Please review the doc and provide your feedback ?
https://cwiki.apache.org/confluence/display/MXNET/JVM+Memory+Management
I had offline discussion with a few
