RE: Question on Spark architecture and DAG

2016-02-12 Thread Mich Talebzadeh
ndy Davidson [mailto:a...@santacruzintegration.com] Sent: 12 February 2016 21:17 To: Mich Talebzadeh <m...@peridale.co.uk>; user@spark.apache.org Subject: Re: Question on Spark architecture and DAG From: Mich Talebzadeh <m...@peridale.co.uk <mailto:m...@peridale.co.uk> > Dat

Re: Question on Spark architecture and DAG

2016-02-12 Thread Andy Davidson
From: Mich Talebzadeh <m...@peridale.co.uk> Date: Thursday, February 11, 2016 at 2:30 PM To: "user @spark" <user@spark.apache.org> Subject: Question on Spark architecture and DAG > Hi, > > I have used Hive on Spark engine and of course Hive tables and its pre

Question on Spark architecture and DAG

2016-02-11 Thread Mich Talebzadeh
Hi, I have used Hive on Spark engine and of course Hive tables and its pretty impressive comparing Hive using MR engine. Let us assume that I use spark shell. Spark shell is a client that connects to spark master running on a host and port like below spark-shell --master