Re: [DISCUSS] Parquet/Arrow/Flight as distributed persistence service

2021-05-17 Thread Gary Pennington
in this space. Cheers, Gary From: David Li Date: Monday, 17 May 2021 at 15:25 To: dev@arrow.apache.org Subject: Re: [DISCUSS] Parquet/Arrow/Flight as distributed persistence service Hey Gary, Sounds like an interesting project! To speak a bit to the Flight question: I don't think you n

Re: [DISCUSS] Parquet/Arrow/Flight as distributed persistence service

2021-05-17 Thread David Li
Hey Gary, Sounds like an interesting project! To speak a bit to the Flight question: I don't think you need a new action; using DoGet/DoPut as you describe makes sense for persistence. There's no required semantics for Flight - it certainly suggests certain patterns (GetFlightInfo -> DoGet for in

[DISCUSS] Parquet/Arrow/Flight as distributed persistence service

2021-05-17 Thread Gary Pennington
Hi, (NB: I first floated this question in the arrow-rust slack channel and Jorge Leitao suggested I should ask here.) I’m cranking up a project to provide functionality based on: parquet/arrow/flight implemented in rust. The primary goals of the project are to provide a mechanism for storing/r