RE: 'Deploy' ignite cluster into a spark cluster

2018-10-15 Thread mamaco
Hi Stan, 'executor die, that leads ignite cluster rebalance', I haven't expected this before. Our solution is strange, it's a bit like borrowing spark job scheduling API to deploy ignite and other platforms, so, how to persuade them work together is the major consideration, below is my plan, will

RE: 'Deploy' ignite cluster into a spark cluster

2018-10-15 Thread Stanislav Lukyanov
27; ignite cluster into a spark cluster Hi Stan, Thank you for providing the information. Yes, it's exact 'embedded deployment', but it looks like to be deprecated because of performance issues. Stanislav Lukyanov wrote > Embedded Mode Deprecation > Embedded mode implies starting I

RE: 'Deploy' ignite cluster into a spark cluster

2018-10-15 Thread mamaco
Hi Stan, Thank you for providing the information. Yes, it's exact 'embedded deployment', but it looks like to be deprecated because of performance issues. Stanislav Lukyanov wrote > Embedded Mode Deprecation > Embedded mode implies starting Ignite server nodes within Spark executors > which can c

RE: 'Deploy' ignite cluster into a spark cluster

2018-10-15 Thread Stanislav Lukyanov
Hi, Sorry, I didn’t really get what you mean here… Can you explain: - What exactly you’re doing? - How is it different from normal Ignite-Spark integration, e.g. from shared deployment (https://apacheignite-fs.readme.io/docs/installation-deployment)? - What would be an alternative solution you’re