unsubscribe
me along that line??
Thanks,
Amit Rana
On 7 Jul 2016 13:44, "Sun Rui" <sunrise_...@163.com> wrote:
> You can read
> https://cwiki.apache.org/confluence/display/SPARK/PySpark+Internals
> For pySpark data flow on worker nodes, you can read the source code of
> PythonRDD.sc
executors and
python interpreter happens using pipes. But I am not able to trace that
data flow.
Please correct me if my understanding is wrong. It would be very helpful
if, someone can help me understand tge code-flow for data transfer between
JVM and python workers.
Thanks,
Amit Rana
