Re: [Spark Core] Custom Catalog. Integration between Apache Ignite and Apache Spark

2017-09-26 Thread Николай Ижиков
Hello, Xin. Thank you for an answer. Is there any plans to make catalog API public? Any specific release versions or dates? 2017-09-25 20:54 GMT+03:00 Reynold Xin : > It's probably just an indication of lack of interest (or at least there > isn't a substantial overlap

Re: [Spark Core] Custom Catalog. Integration between Apache Ignite and Apache Spark

2017-09-25 Thread Reynold Xin
It's probably just an indication of lack of interest (or at least there isn't a substantial overlap between Ignite users and Spark users). A new catalog implementation is also pretty fundamental to Spark and the bar for that would be pretty high. See my comment in SPARK-17767. Guys - while I

Re: [Spark Core] Custom Catalog. Integration between Apache Ignite and Apache Spark

2017-09-19 Thread Nikolay Izhikov
Guys, Anyone had a chance to look at my message? 15.09.2017 15:50, Nikolay Izhikov пишет: Hello, guys. I’m contributor of Apache Ignite project which is self-described as an in-memory computing platform. It has Data Grid features: distribute, transactional key-value store [1], Distributed

[Spark Core] Custom Catalog. Integration between Apache Ignite and Apache Spark

2017-09-15 Thread Nikolay Izhikov
Hello, guys. I’m contributor of Apache Ignite project which is self-described as an in-memory computing platform. It has Data Grid features: distribute, transactional key-value store [1], Distributed SQL support [2], etc…[3] Currently, I’m working on integration between Ignite and Spark