Re: Using ignite with spark

Hi Patrick, Actually, Ignite by itself provides very rich SQL support [1]. So it sounds like you can achieve your goals even without Spark: save all the data in Ignite cluster, probably with persistence enabled [2] and run SQL against this data. You will be able to create any arbitrary indexes and

Re: Using ignite with spark

Hello Val First of all thx for this answer. Let me explain our use case. *What we are doing* Our company is a monitoring solution for machines in the manufacturing industry. We have a hardware logger attached to each machine wich collects up to 6 different metrics ( like power, piece count ). T

Re: Using ignite with spark

Hello Patrick, See my comments below. Most of your questions don't have a generic answer and would heavily depend on your use case. Would you mind giving some more details about it so that I can give more specific suggestions? -Val On Thu, Sep 21, 2017 at 8:24 AM, Patrick Brunmayr < patrick.bru

Using ignite with spark

Hello - What is currently the best practice of deploying Ignite with Spark ? - Should the Ignite node sit on the same machine as the Spark executor ? According to this documentation Spark should be given 75% of machine mem