Re: Sharing data in columnar storage between two applications

2016-12-26 Thread Mark Hamstra
Yes, this is part of Matei's current research, for which code is not yet publicly available at all, much less in a form suitable for production use. On Mon, Dec 26, 2016 at 2:29 AM, Evan Chan wrote: > Looks pretty interesting, but might take a while honestly. > > On Dec 25,

Re: Sharing data in columnar storage between two applications

2016-12-25 Thread Mark Hamstra
NOt so much about between applications, rather multiple frameworks within an application, but still related: https://cs.stanford.edu/~matei/papers/2017/cidr_weld.pdf On Sun, Dec 25, 2016 at 8:12 PM, Kazuaki Ishizaki wrote: > Here is an interesting discussion to share data

Sharing data in columnar storage between two applications

2016-12-25 Thread Kazuaki Ishizaki
Here is an interesting discussion to share data in columnar storage between two applications. https://github.com/apache/spark/pull/15219#issuecomment-265835049 One of the ideas is to prepare interfaces (or trait) only for read or write. Each application can implement only one class to want to