RE: Hive External Storage Handlers

2016-07-19 Thread Lavelle, Shawn
...@gmail.com] Sent: Tuesday, July 19, 2016 10:58 AM To: user@hive.apache.org Subject: Re: Hive External Storage Handlers The main reason is that if you compile it yourself then nobody can understand what you did. Hence any distribution can be downloaded and people can follow what you did. As far as I

Re: Hive External Storage Handlers

2016-07-19 Thread Jörn Franke
The main reason is that if you compile it yourself then nobody can understand what you did. Hence any distribution can be downloaded and people can follow what you did. As far as I recall you had described several problems that the distributions did not have (eg you could not compile tez, spark

RE: Hive External Storage Handlers

2016-07-19 Thread Lavelle, Shawn
: Re: Hive External Storage Handlers "So not use a self-compiled hive or Spark version, but only the ones supplied by distributions (cloudera, Hortonworks, Bigtop...) You will face performance problems, strange errors etc when building and testing your code using self-compiled versions.&q

Re: Hive External Storage Handlers

2016-07-18 Thread Mich Talebzadeh
"So not use a self-compiled hive or Spark version, but only the ones supplied by distributions (cloudera, Hortonworks, Bigtop...) You will face performance problems, strange errors etc when building and testing your code using self-compiled versions." This comment does not make sense and is meanin

Re: Hive External Storage Handlers

2016-07-18 Thread Jörn Franke
So not use a self-compiled hive or Spark version, but only the ones supplied by distributions (cloudera, Hortonworks, Bigtop...) You will face performance problems, strange errors etc when building and testing your code using self-compiled versions. If you use the Hive APIs then the engine shou

Re: Hive External Storage Handlers

2016-07-18 Thread Mich Talebzadeh
Hi, You can move up to Hive 2 that works fine and pretty stable. You can opt for Hive 1.2.1 if yoy wish. If you want to use Spark (the replacement for Shark) as the execution engine for Hive then the version that works (that I have managed to make it work with Hive is Spark 1.3.1) that you will n