But currently you start the same Ignite nodes which you will start in
standalone mode, but you run them embedded.
If you have 3 backups in the cluster and one of your nodes fails, then part
of your data will have 2 backups. Also, after the returning to the cluster,
without manual rebalancing, some
yes i am using it in embeded mode. Standalone mode we can go for, but
additional hardware needed for that which will stay idle when we don't use
it. That was the reason to try this embedded stuff. We build the cache on
fly , which gets shut down with spark.
My question basically was, when i set re
> When due to some reason a task fails, the ignite node stops and when the
task re-starts,
Looks like you run in embedded mode. Do avoid too frequently node stopping
events, you need to run Ignite in standalone mode, in this case, the node
will run even if your task fails.
Please let me know if I
I read the data which is in avro format using spark sql and load it to
cache from spark program. I build the Ignite key-store inside spark
executors. When due to some reason a task fails, the ignite node stops and
when the task re-starts,
the new node joins back.I see slowness from here onwards. I
Ranjit,
How do you load data to the cache?
Evgenii
2018-02-01 11:18 GMT+03:00 Ranjit Sahu :
> Hi Val,
>
> Not always but out of 10, we see at least once the issue. Whats happening
> is when one node crashes\stops the new node joins . The loading process
> restarts but what ever was happening in
Hi Val,
Not always but out of 10, we see at least once the issue. Whats happening
is when one node crashes\stops the new node joins . The loading process
restarts but what ever was happening in few minutes (3-5) goes to 2-3
hours.
Thanks,
Ranjit
On Wed, Jan 31, 2018 at 3:12 AM, vkulichenko
wrot
Ranjit,
Is it a really frequent event for node to crash in the middle of loading
process? If so, then I think you should fix that instead of working around
by disabling rebalancing. Such configuration definitely has a lot drawbacks
and therefore can cause issues.
-Val
--
Sent from: http://apac
Hi,
Do you understand that in this case rebalance won't happen automatically at
all and you will need to make it manually?
Evgenii
2018-01-30 18:16 GMT+03:00 Ranjit Sahu :
> Hi Guys,
>
> If i set back up count to 3 and rebalncing mode to None , do you think
> there are any issues? I want to avo
Hi Guys,
If i set back up count to 3 and rebalncing mode to None , do you think
there are any issues? I want to avoid the rebalncing of data when a node
crashes and a new one joins which is slowing down loading the data to
cache.
Thanks,
Ranjit
