Memory usage for spark types

2016-09-18 Thread assaf.mendelson
tual type handling? Thanks, Assaf. -- View this message in context: http://apache-spark-developers-list.1001551.n3.nabble.com/Memory-usage-for-spark-types-tp18984.html Sent from the Apache Spark Developers List mailing list archive at Nabble.com.

Re: Memory usage for spark types

2016-09-18 Thread Reynold Xin
code that handles the > actual type handling? > > Thanks, > > Assaf. > > -- > View this message in context: Memory usage for spark types > <http://apache-spark-developers-list.1001551.n3.nabble.com/Memory-usage-for-spark-types-tp18984.html> > Sent from the Apache Spark Developers List mailing list archive > <http://apache-spark-developers-list.1001551.n3.nabble.com/> at > Nabble.com. >

RE: Memory usage for spark types

2016-09-20 Thread assaf.mendelson
anyone point me in the right direction? From: rxin [via Apache Spark Developers List] [mailto:ml-node+s1001551n18985...@n3.nabble.com] Sent: Monday, September 19, 2016 12:23 AM To: Mendelson, Assaf Subject: Re: Memory usage for spark types Take a look at UnsafeArrayData and UnsafeMapData. On Sun