RE: hive memory error: GC overhead limit exceeded

2016-02-23 Thread Gary Clark
The problem is that your garbage collector has maxed out. One of the ways I got around this was to reduce your datasets in the query that your running. Increasing limits is a temporary solution and eventually it will be hit. Thanks, Gazza From: Daniel Lopes [mailto:dan...@bankfacil.com.br]

Seeing strange limit

2015-12-30 Thread Gary Clark
Hello, I have a multi-node cluster (hadoop 2.6.0) and am seeing the below message causing the hive workflow to fail: Looking at the hadoop logs I see the below: 45417 [main] ERROR org.apache.hadoop.hive.ql.Driver - FAILED: Execution Error, return code -101 from

RE: Seeing strange limit

2015-12-30 Thread Gary Clark
r xmx. On Wednesday, December 30, 2015, Gary Clark <gcl...@neces.com<mailto:gcl...@neces.com>> wrote: Hello, I have a multi-node cluster (hadoop 2.6.0) and am seeing the below message causing the hive workflow to fail: Looking at the hadoop logs I see the below: 45417 [main] ERROR

RE: Seeing strange limit

2015-12-30 Thread Gary Clark
as well. On Wednesday, December 30, 2015, Gary Clark <gcl...@neces.com<mailto:gcl...@neces.com>> wrote: -Xmx1024m -XX:-UseGCOverheadLimit I think this is the limit I need to tweak. From: Gary Clark [mailto:gcl...@neces.com<javascript:_e(%7B%7D,'cvml','gcl...@neces.com');>

Problem with Hive metastore

2015-10-15 Thread Gary Clark
Hello, I hit a problem this morning: ./hive –service metastore Caused by: MetaException(message:Could not connect to meta store using any of the URIs provided. Most recent failure: org.apache.thrift.transport.TTransportException: java.net.ConnectException: Connection refused I did not see

RE: Problem with Hive metastore

2015-10-15 Thread Gary Clark
is virus free, therefore neither Peridale Ltd, its subsidiaries nor their employees accept any responsibility. From: Gary Clark [mailto:gcl...@neces.com] Sent: 15 October 2015 16:16 To: user@hive.apache.org<mailto:user@hive.apache.org> Subject: Problem with Hive metastore Hello, I hit

RE: Problem with Hive metastore

2015-10-15 Thread Gary Clark
their employees accept any responsibility. From: Gary Clark [mailto:gcl...@neces.com] Sent: 15 October 2015 21:39 To: user@hive.apache.org<mailto:user@hive.apache.org> Subject: RE: Problem with Hive metastore Thanks yes I did that and the blighter was still failing. I am going to dig around

GC Overhead

2015-10-13 Thread Gary Clark
Hello, I am seeing the below. I did have Heap errors before so I increased the JAVA heap memory. Not sure how to get rid of the below from the hadoop logs its causing the job to hang and then fail: >>> Invoking Hive command line now >>> Heart beat 40164 [main] ERROR

RE: start hiveserver2 failed need help

2015-08-03 Thread Gary Clark
For the sake of the hive user community could you post how you resolve it :) Thanks, Gary Clark From: Garry Chen [mailto:g...@cornell.edu] Sent: Monday, August 03, 2015 4:24 PM To: user@hive.apache.org Subject: RE: start hiveserver2 failed need help I found the problem and case solved. Garry

hive-server2 crashing OOM error

2015-07-28 Thread Gary Clark
Hello, I have been pushing large amount of data into a location which hive uses to map to. I am now seeing this. Not sure but its caused the hiveserver2 to crash. Anybody else seen this? Looks like my heap is exhausted. Don’t know what would cause this. [user@master bin]# ./hive --service

RE: creating a table based on where column=x

2015-06-09 Thread Gary Clark
external table as you described and a view which looks like the 2nd table. Abe On Tue, Jun 9, 2015 at 9:44 AM, Gary Clark gcl...@neces.commailto:gcl...@neces.com wrote: Hello, I would like to create a table based on a selection in hive. Currently I am creating a table based on a location which

creating a table based on where column=x

2015-06-09 Thread Gary Clark
Hello, I would like to create a table based on a selection in hive. Currently I am creating a table based on a location which contains the source csv files and then deriving other tables from that table. I.e: create EXTERNAL TABLE initialtable (deployment_id tinyint,

RE: Reading Json files in hive

2015-06-05 Thread Gary Clark
CREATE EXTERNAL TABLE IF NOT EXISTS sampledata ( id string, type string, label string, realpoweroutput string, realpowerdemand string, reactivepoweroutput string, kvarpowerdemand string, averagesoc string,

RE: Reading Json files in hive

2015-06-05 Thread Gary Clark
Hive version is - 0.14 On Fri, Jun 5, 2015 at 10:39 AM, Gary Clark gcl...@neces.commailto:gcl...@neces.com wrote: CREATE EXTERNAL TABLE IF NOT EXISTS sampledata ( id string, type string, label string, realpoweroutput string, realpowerdemand string

RE: Error when connecting Hue to HiveServer2

2015-04-17 Thread Gary Clark
that this email is virus free, therefore neither Peridale Ltd, its subsidiaries nor their employees accept any responsibility. From: Gary Clark [mailto:gcl...@neces.com] Sent: 17 April 2015 17:39 To: user@hive.apache.orgmailto:user@hive.apache.org Subject: RE: Error when connecting Hue to HiveServer2 Hi

RE: Error when connecting Hue to HiveServer2

2015-04-17 Thread Gary Clark
CLOSE_WAIT 2373/java tcp0 0 127.0.0.1:1 127.0.0.1:48438 CLOSE_WAIT 2373/java tcp0 0 127.0.0.1:1 127.0.0.1:48480 CLOSE_WAIT 2373/java Ip addresses: Thanks, Gary C From: Gary Clark [mailto:gcl

RE: Error when connecting Hue to HiveServer2

2015-04-17 Thread Gary Clark
or their employees, unless expressly so stated. It is the responsibility of the recipient to ensure that this email is virus free, therefore neither Peridale Ltd, its subsidiaries nor their employees accept any responsibility. From: Gary Clark [mailto:gcl...@neces.com] Sent: 17 April 2015 17:27

Error when connecting Hue to HiveServer2

2015-04-17 Thread Gary Clark
Hey Guys, I am see the following error when attempting to connect Hue to the hive metatstore: From hive-site.log 015-04-17 05:12:48,857 INFO [main]: metastore.HiveMetaStore (HiveMetaStore.java:addAdminUsers_core(679)) - No user is added in admin role, since config is empty 2015-04-17

RE: Error when connecting Hue to HiveServer2

2015-04-17 Thread Gary Clark
transport /description /property Was None before. Thanks, Gary From: Gary Clark [mailto:gcl...@neces.com] Sent: Friday, April 17, 2015 1:33 PM To: user@hive.apache.org Subject: RE: Error when connecting Hue to HiveServer2 2015-04-17 08:24:12,858 DEBUG [HiveServer2-Handler-Pool: Thread-23

RE: Error when connecting Hue to HiveServer2

2015-04-17 Thread Gary Clark
subsidiaries nor their employees accept any responsibility. From: Gary Clark [mailto:gcl...@neces.com] Sent: 17 April 2015 19:56 To: user@hive.apache.orgmailto:user@hive.apache.org Subject: RE: Error when connecting Hue to HiveServer2 The below I had to set to avoid on a derby database to get past

oozie workflow with hive issue

2015-04-08 Thread Gary Clark
Hello, Using Hadoop 2.6.0 and OOZIE 4.1.0 with apache-hive 1.0. I am seeing an issue with the oozie workflow example failing. Its two instructions CREATE EXTERNAL TABLE test (a INT) STORED AS TEXTFILE LOCATION '${INPUT}'; INSERT OVERWRITE DIRECTORY '${OUTPUT}' SELECT * FROM test; The first