Re: java.lang.NoClassDefFoundError: com/jayway/jsonpath/PathUtil

Hi, It clearly is a classpath issue! When you do a select * from tab , it works because HIve just fetches the data from HDFS using a FetchTask and doesn't start any MR job (It probably uses json jar in your local hive lib directory to deserialize and limit the rows to 5 and hence not raising any

Re: Hive Reducers hanging - interesting problem - skew ?

- World Finance's Forex Awards 2009. > "The One to Watch" - Treasury Today's Adam Smith Awards 2009. > > > - Original Message - > From: "john smith" > To: user@hive.apache.org > Sent: Monday, December 5, 2011 4:38:14 PM > Subject: Hive Reducers

Hive Reducers hanging - interesting problem - skew ?

Hi list, I am trying to run a Join query on my 10 node cluster. My query looks as follows select * from A JOIN B on (A.a = B.b) size of A = 15 million rows size of B = 1 million rows The problem is A.a and B.b has around 25-30 distinct values per column which implies that they have high selecti

Attaching YourKit profiler with Hive

Hi folks, Can we get a shared license key for yourkit and use it with Hive project? The wiki page has no information about this. Can any dev help me in this regard? Thanks, jS

Profiling Hive / Metrics

Hey devs, My Hive reducers are running for too long. I wan't to profile Hive and collect metrics so as to find where most of the time is spent in execution. Can any one tell me where to start ? Are any profilers attached to Hive by default? Any help is appreciated. Thanks, jS

Re: hive runs slowly

, Edward Capriolo wrote: > > > On Fri, Oct 21, 2011 at 10:21 AM, john smith wrote: > >> Hi Edward, >> >> Thanks for replying. I have been using the query >> >> "select a,b from a,b where a.id=b.id ". According to my knowledge of >> Hive, it

Re: hive runs slowly

ct 21, 2011 at 9:22 AM, john smith wrote: > >> Hi list, >> >> I am also facing the same problem. My reducers hang at this position and >> it takes hours to complete a single reduce task. Can any hive guru help us >> out with this issue. >> >> Thanks, >

Re: hive runs slowly

Hi list, I am also facing the same problem. My reducers hang at this position and it takes hours to complete a single reduce task. Can any hive guru help us out with this issue. Thanks, jS 2011/10/21 bangbig > HI all, > > HIVE runs too slowly when it is doing such things(see the log below), wh

Re: Reducer hanging ( swapping? )

rote: > 2GB for a task tracker? Here are some possible thoughts. > Compress map output. > Change mapred.reduce.slowstart.completed.maps > > > By the way I see no swapping. Anything interesting from the task tracker > log? System log? > > Raj > > > > > &g

Re: Running Hive from Eclipse

Hi, See in the line that log4j props is not in found .. I added Hive_conf dir to the classpath while running and now I get this trace .. http://pastebin.com/vXs98aZ5 I am completely clueless ! Thanks JS On Fri, Aug 12, 2011 at 9:54 AM, john smith wrote: > Hi Carl, > > This is

Re: Running Hive from Eclipse

ed up with log4j props but I wonder why this is happening. THanks On Fri, Aug 12, 2011 at 2:12 AM, Carl Steinbach wrote: > Hi John, > > Can you please include the error messages/exceptions that you're > encountering? > > Thanks. > > Carl > > > On Thu, Aug 11,

Running Hive from Eclipse

Hi folks, I am trying to run Hive from eclipse. I've set it up correctly and it is building the jars and stuff. However I face execeptions when I try to run hive queries like "show tables" etc. There has been a discussion on this in the mailing list previously but there was no solution provided.