Re: PySpark Serialization/Deserialization (Pickling) Overhead

2017-03-12 Thread Li Jin
e case, how can I actually measure the serialization/deserialization overhead? Thanks, Yeoul -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/PySpark-Serialization-Deserialization-Pickling-Overhead-tp28468.html Sent from the Apache Spark User List mailing

Re: PySpark Serialization/Deserialization (Pickling) Overhead

2017-03-08 Thread rok
in PySpark? If this is > not the case, how can I actually measure the serialization/deserialization > overhead? > > Thanks, > Yeoul > > -- > If you reply to this email, your message will be added to the discussion > below: > http://apache-spark-user-li

PySpark Serialization/Deserialization (Pickling) Overhead

2017-03-07 Thread Yeoul Na
the case, how can I actually measure the serialization/deserialization overhead? Thanks, Yeoul -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/PySpark-Serialization-Deserialization-Pickling-Overhead-tp28468.html Sent from the Apache Spark User List mailing list a