Re: Tungsten off heap memory access for C++ libraries

https://issues.apache.org/jira/browse/SPARK-10399 Is the jira to track. On Sep 1, 2015 5:32 PM, "Paul Wais" wrote: > Paul: I've worked on running C++ code on Spark at scale before (via JNA, > ~200 > cores) and am working on something more contribution-oriented now (via >

Re: Tungsten off heap memory access for C++ libraries

ility, i.e. how we can have a native (e.g. > C++) API for data access shipped with Spark. There are a lot of questions > (e.g. build, portability) that need to be answered. > > On Mon, Aug 31, 2015 at 1:12 AM, Reynold Xin <r...@databricks.com> wrote: > >> >>

Re: Tungsten off heap memory access for C++ libraries

, Paul Weiss paulweiss@gmail.com wrote: Hi, Would the benefits of project tungsten be available for access by non-JVM programs directly into the off-heap memory? Spark using dataframes w/ the tungsten improvements will definitely help analytics within the JVM world but accessing

Tungsten off heap memory access for C++ libraries

Hi, Would the benefits of project tungsten be available for access by non-JVM programs directly into the off-heap memory? Spark using dataframes w/ the tungsten improvements will definitely help analytics within the JVM world but accessing outside 3rd party c++ libraries is a challenge