[ https://issues.apache.org/jira/browse/ARROW-11103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17257291#comment-17257291 ]
GANG LIAO edited comment on ARROW-11103 at 1/2/21, 5:09 AM: ------------------------------------------------------------ I found that Arrow’s data type and schema both support serialization into JSON ([https://github.com/apache/arrow/pull/3016/files]). Can the community also support the physical plan serialization? Or are there other challenges? If datafusion does not support serialization, we can only extend it externally via this post: [https://serde.rs/impl-serializer.html#implementing-a-serializer] was (Author: gangliao): I found that Arrow’s data type and schema both support serialization into JSON (https://github.com/apache/arrow/pull/3016/files). Can the community serialize physical plans? Or are there other challenges? If datafusion does not support serialization, we can only extend it externally via this post: https://serde.rs/impl-serializer.html#implementing-a-serializer > [Rust] [DataFusion] serialize and deserialize physical plan by serde > -------------------------------------------------------------------- > > Key: ARROW-11103 > URL: https://issues.apache.org/jira/browse/ARROW-11103 > Project: Apache Arrow > Issue Type: Wish > Reporter: GANG LIAO > Priority: Critical > > It is important to send part of the generated physical plan to other servers > over the network for distributed computation. -- This message was sent by Atlassian Jira (v8.3.4#803005)