Don't know much about Spark + Arrow efforts myself; just wanted to share the reference.
On Fri, Aug 5, 2016 at 6:53 PM Jim Pivarski <jpivar...@gmail.com> wrote: > On Fri, Aug 5, 2016 at 5:14 PM, Nicholas Chammas < > nicholas.cham...@gmail.com> wrote: > >> Relevant jira: https://issues.apache.org/jira/browse/SPARK-13534 >> > > Thank you. This ticket describes output from Spark to Arrow for flat > (non-nested) tables. Are there no plans to input from Arrow to Spark for > general types? Did I misunderstand the blogs? > > I don't see it in this search: > https://issues.apache.org/jira/browse/SPARK-13534?jql=project%20%3D%20SPARK%20AND%20text%20~%20%22arrow%22 > > I'm beginning to think there's some misleading information out there (like > this diagram: https://arrow.apache.org/img/shared2.png). > > -- JIm > >
