Hi Bairen, Your comment is just on spot. The development of a c++ Api for crail is one of the top items on the roadmap, in partical to facilitate the integration into tensorflow and serverless. In fact i started drafting a prototype two weeks ago that i wanted to share soon. If you are interested in helping let us know!
On Feb 17, 2018 1:49 PM, "Bairen YI" <[email protected]> wrote: HI folks, I have been looking into you guys’ work for a long time and it is great to see Crail accepted as an Apache Incubator project. I authored the GPU Direct RDMA transport for TensorFlow ( https://github.com/tensorflow/tensorflow/pull/11392), and I would love to see how we could design an end-to-end zero-copy dataflow from Crail to various deep learning framework such as TensorFlow ( https://dl.acm.org/citation.cfm?doid=3123878.3131975). Is there any roadmap for Crail as a standalone language-independent FileSystem/Cache service with C API? That would really ease the integration into non-JVM based third party system. It does not have to be HDFS compatible if that brings extra performance cost. Best, Bairen
