Re: Deprecate IgniteRDD in embedded mode

2017-12-01 Thread Valentin Kulichenko
Ticket created: https://issues.apache.org/jira/browse/IGNITE-7092 -Val On Thu, Nov 30, 2017 at 5:01 PM, Denis Magda wrote: > Val, > > Sounds reasonable to me. The fewer useless and potentially harmful > features or “switches” we have in Ignite the clear it will be for the user > how to use us i

Re: Deprecate IgniteRDD in embedded mode

2017-11-30 Thread Denis Magda
Val, Sounds reasonable to me. The fewer useless and potentially harmful features or “switches” we have in Ignite the clear it will be for the user how to use us in a right way. +1 for the deprecation and further removal. — Denis > On Nov 30, 2017, at 3:07 PM, Valentin Kulichenko > wrote: >

Re: Deprecate IgniteRDD in embedded mode

2017-11-30 Thread Holden Karau
So for what it's worth more and more of Spark's own services have also moved to be in separate processes, and with the increased work around scaling the executors are going to continue this trend. On Thu, Nov 30, 2017 at 3:07 PM, Valentin Kulichenko < valentin.kuliche...@gmail.com> wrote: > Ignit

Deprecate IgniteRDD in embedded mode

2017-11-30 Thread Valentin Kulichenko
Igniters, Currently we claim to support IgniteRDD in two modes: standalone and embedded. Standalone means there is a separately running Ignite cluster, and Spark start client node(s) to interact with it. In embedded node everything runs within Spark, including Ignite server nodes that are started