Ivan, what kind of tests did u run ? plz show SQL requests ?
1-node tests for distributed computing looks like wierd

My observations (on very simplified 1-node environment) show that Ignite-MR ~10% faster than TEZ under equal >conditions.

On Mon, May 15, 2017 at 1:52 PM, Ivan V. <iveselovs...@gridgain.com> wrote:
Hi, Alena, regarding "1) Ignite MR works slower than Hive on TEZ, but faster than Hive on MR." -- as far as >>I remember, you have observed incorrect results with Ignite MR, and we didn't find the reason, just abandoned that. >>Performance measurements don't have much sense until we have correct query results. So, I would say that there we >>just don't have results we can trust.

Regarding ""Out of memory: Kill process" -- this means that Ignite node process requested so much memory that OS >>failed to give. This may be investigated further -- all the memory limits set for Ignite node should be checked and >>compared to the real memory physically available on the host. Do I correctly understand that Ignite MR was not used >>in that experiment?

On Mon, May 15, 2017 at 9:32 AM, Alena Melnikova <al...@74.ru> wrote:
Hi Ivan,

You're right. In kernel log there is message: "Out of memory: Kill process
19988 (java)"

Let me sum up, please, correct me if I'm wrong.
If we use Hive + Tez we don't need Hadoop Accelerator because:
1) Ignite MR works slower than Hive on TEZ, but faster than Hive on MR.
2) TEZ+HDFS and TEZ+IGFS work at the same speed. Although TEZ+IGFS can be
faster in queries with intensive I/O (need to test).

Many thanks for your patience and prompt help.
I'm going to try Ignite + Spark, I'll open new topic)



--
View this message in context: http://apache-ignite-users.70518.x6.nabble.com/HDP-Hive-Ignite-tp12195p12838.html
Sent from the Apache Ignite Users mailing list archive at Nabble.com.

Reply via email to