Alena, regarding comparison of your Hive query on TEZ+HDFS vs. TEZ+IGFS: my experiments show same results (~58 sec in average) for both. At least not distinguishable within dispersion. I suppose, in this usecase fetching the table data takes negligible time as compared to overall task processing time. (I used primary IGFS mode and explicitly loaded the data to avoid any non-cached data cold start effects.) IGFS may give noticeable speedup for tasks that really involve large disk I/O, this one does not seem to be such. Also please note, that some file data are cached in memory by the operating system, so even if you read from disk you frequently read from memory, in fact.
On Fri, May 12, 2017 at 3:52 PM, Ivan Veselovsky <iveselovs...@gridgain.com> wrote: > Alena, > as I understand, the message "19988 Killed "$JAVA"" means that the Ignite > node process was killed by the operating system. Can you please see the > kernel log -- what does it say near the node crash time? > > > > > > -- > View this message in context: http://apache-ignite-users. > 70518.x6.nabble.com/HDP-Hive-Ignite-tp12195p12660.html > Sent from the Apache Ignite Users mailing list archive at Nabble.com. >
