Re: Hive setup on Hadoop cluster

2016-05-20 Thread JOHN MILLER
Greetings Mich Sending u a partilal listing of my hive.log Problem areas are in bold type from=org.apache.hadoop.hive.ql.exec.Utilities> 2016-05-20 07:51:19,500 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2016-05-20 07:51:19,501 INFO [main]: exec.Utilities

Re: Hive setup on Hadoop cluster

2016-05-20 Thread JOHN MILLER
Greetings Attached is the results of the select count(1) from table The contents of the dataset(table) is 18 columns and 3340 rows hive> select count(1) from commoncrawl18; Query ID = jmill383_20160520074710_3b5ee662-2ead-4d89-9123-df9b2cf6e2d7 Total jobs = 1 Launching Job 1 out of 1 Number of

Re: Hive setup on Hadoop cluster

2016-05-19 Thread Mich Talebzadeh
Hi John, stderr does not say much Exception in thread "main" java.lang.IncompatibleClassChangeError: Implementing class at java.lang.ClassLoader.defineClass1(Native Method) at java.lang.ClassLoader.defineClass(ClassLoader.java:800) at

Re: Hive setup on Hadoop cluster

2016-05-18 Thread Mich Talebzadeh
Hi John, I see this error Stage-Stage-1: HDFS Read: 0 HDFS Write: 0 FAIL Can you check in case you have a problem under Hadoop storage or you have an issue with your user say hduser on Linux! HTH Dr Mich Talebzadeh LinkedIn *

Re: Hive setup on Hadoop cluster

2016-05-18 Thread JOHN MILLER
Greetings Thanx Sure can. Below is from HIVE CLI hive> select count(distinct warctype) from commoncrawl18 where warctype='warcinfo'; Query ID = jmill383_20160518143715_34041e3e-713b-4e35-ae86-a88498192ab1 Total jobs = 1 Launching Job 1 out of 1 Number of reduce tasks determined at compile

Re: Hive setup on Hadoop cluster

2016-05-18 Thread Mich Talebzadeh
Hi John, can you please a new thread for your problem so we can deal with separately. thanks Dr Mich Talebzadeh LinkedIn * https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw *

Re: Hive setup on Hadoop cluster

2016-05-18 Thread JOHN MILLER
Greetings Mitch I have an issue with running mapreduce in hive I am getting a FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.mr.MapRedTask error while attemtiing to execute SELECT DISTINCT(fieldname) FROM TABLE x or SELECT COUNT(*) FROM TABLE x;; Trying to run

Re: Hive setup on Hadoop cluster

2016-05-18 Thread Mich Talebzadeh
Hi Kuldeep, Have you installed hive on any of these nodes. Hive is basically an API. You will also need to install sqoop as well if you are going to import data from other RDBMss like Oracle, Sybase etc. Hive has a very small footprint so my suggestion is to install it on all your boxes and

Hive setup on Hadoop cluster

2016-05-18 Thread Kuldeep Chitrakar
I have a very basic question regarding Hadoop & Hive setup. I have 7 Machines say M1,M2,M3,M4,M5,M6,M7 Hadoop Cluster Setup: Namenode: M1 Seondary Namenode: M2 Datanodes: M3,M4,M5 Now question is: Where do I need to install Hive. 1. Should I install Hiverserver on M6 a. if yes