Re: Problème with min function in HiveQL

2013-08-30 Thread Jérôme Verdier
Ok, thanks for this solution. Unfortunately, i have rewrited my script like this : INSERT INTO TABLE default.THM_CA_RGRP_PRODUITS_SEM SELECT '${hiveconf:in_co_societe}' as co_societe, '${hiveconf:in_co_an_semaine}'as co_an_semaine, a.type

Re: Problème with min function in HiveQL

2013-08-30 Thread Stephen Sprague
awright Jerome. look closely at the error message. you can figure this one out. On Fri, Aug 30, 2013 at 1:17 AM, Jérôme Verdier wrote: > Ok, thanks for this solution. > > Unfortunately, i have rewrited my script like this : > > INSERT INTO TABLE default.THM_CA_RGRP_PRODUITS_SEM > > SELE

Re: Problème with min function in HiveQL

2013-08-30 Thread Jérôme Verdier
Thanks Stephen, Yes i realise that it was so a stupid questionMaybe i wasn't really awaked this morning ;-) now it's working well. Thanks everyone. 2013/8/30 Stephen Sprague > awright Jerome. look closely at the error message. you can figure this > one out. > > > On Fri, Aug 30, 2013 at

Re: Problème with min function in HiveQL

2013-08-30 Thread Jérôme Verdier
Hi, Is it possible to have multiple conditions in Having clause ? I get an error when i'm trying this. Thanks a lot. 2013/8/30 Jérôme Verdier > Thanks Stephen, > > Yes i realise that it was so a stupid questionMaybe i wasn't really > awaked this morning ;-) > > now it's working well. > >

Mappers per job per user

2013-08-30 Thread Brad Ruderman
Hi All- I was hoping to gather some insight in how the hadoop (and or hive) job scheduler distributes mappers per user. I am running into an issue where I see that hadoop (and or hive) is evenly distributing mappers per user instead of per job. For example: -We have 1000 mapper capacity -10 Jobs a

Pseudo column for the entire Line/Row ?

2013-08-30 Thread Stephen Boesch
I am writing a UDF that will perform validation on the input row and shall require access to every column in the row (or alternatively to simply the unparsed/pre-processed line). Is there any way to achieve this? Or will it be simply necessary to declare an overloaded evaluate() method with a sig

Hive - MR Join TaskAttemptListenerImpl +Spill failed

2013-08-30 Thread fasi meg
I have multiple tables, and was trying to recursively join them. The first join finishes with no error but not the second  i am not sure if it have something to do using hive tables as input to the next join... because every time I use external tables that i created there is no error at all, it

Re: Mappers per job per user

2013-08-30 Thread Ravi Kiran
Hi Brad, I believe you have configured a Capacity Scheduler for scheduling the jobs rather than the default FIFO scheduler. Regards Ravi Magham On Fri, Aug 30, 2013 at 10:07 PM, Brad Ruderman wrote: > Hi All- > I was hoping to gather some insight in how the hadoop (and or hive) job > schedul

Re: Mappers per job per user

2013-08-30 Thread kumar y
and you can find that by looking at your mapred-site.xml . look for this property mapred-site.xml: mapred.jobtracker.taskScheduler you should be using the default FIFO or org.apache.hadoop.mapred.FairScheduler or org.apache.hadoop.mapred.CapacityTaskScheduler Depends on what scheduler you are

Re: Mappers per job per user

2013-08-30 Thread Brad Ruderman
Hi Kumar and Ravi- Thanks for your quick responses. Although I don't believe changing anything from default, it is possible because we are using a distribution. I will check. Thanks! Brad On Fri, Aug 30, 2013 at 1:46 PM, kumar y wrote: > > and you can find that by looking at your mapred-site

Re: Problème with min function in HiveQL

2013-08-30 Thread Stephen Sprague
there should be no limitation AFAIK. example + error message is always helpful - even if you might regret it. :) On Fri, Aug 30, 2013 at 8:16 AM, Jérôme Verdier wrote: > Hi, > > Is it possible to have multiple conditions in Having clause ? > > I get an error when i'm trying this. > > Thanks a

how to write hive query to solve this problem?

2013-08-30 Thread qiaoresearcher
I have three tables: Table 1: record when and who visited gas station or not, this contains all the users of interest, name all the users as a set A date | user name| visited gas station? 2013-09-01 tom yes 2013

Re: how to write hive query to solve this problem?

2013-08-30 Thread Stephen Sprague
so this is not particular to Hive is it? You could post this on a DB2, Oracle, or even Stackflow board i'd imagine. On Fri, Aug 30, 2013 at 4:34 PM, qiaoresearcher wrote: > > I have three tables: > > Table 1: record when and who visited gas station or not, this contains all > the users of intere

Hive Statistics information

2013-08-30 Thread Sanjay Subramanian
Hi guys I have configured Hive to use MySQL for all statistics hive.stats.atomic=false hive.stats.autogather=true hive.stats.collect.rawdatasize=true hive.stats.dbclass=jdbc:mysql hive.stats.dbconnectionstring=jdbc:mysql://v-so1.nextagqa.com/hive_vso1_tempstatsstore?&user=hive_user_vso1&password=

Re: Hive Statistics information

2013-08-30 Thread Ravi Kiran
Hi Sanjay, What do the logs say when you fire the ANALYZE TABLE... statement on a table ? One minor correction to the db connectionstring would be to use & for the query parameters. hive.stats.dbconnectionstring=jdbc:mysql:// v-so1.nextagqa.com/hive_vso1_tempstatsstore?user=hive_user_vso1&