Re: Query crawls through reducer

[Nitin Pawar]

instead of >= can you just try =  if you want to limit top 100 (b being a
partition  i guess it will have more that 100 records to fit into your
limit)

to improve your query performance your table file format matters as well.
Which one are you using?
how many partitions are there?
what's the size of the cluster?
you can set the number of reducers but if your query just has one key then
only one reducer will get the data and rest will run empty



On Sat, Mar 23, 2013 at 4:32 AM, Keith Wiley  wrote:

> The following query translates into a many-map-single-reduce job (which is
> common) and also slags through the reduce stage...it's killing the overall
> query:
>
> select * from a where b >= 'c' order by b desc limit 100
>
> Note that b is a partition.  What component is making the reducer heavy?
>  Is it the order by or the limit (I'm sure it's not the partition-specific
> where clause, right?)?  Are there ways to improve its performance?
>
>
> 
> Keith Wiley kwi...@keithwiley.com keithwiley.com
> music.keithwiley.com
>
> "You can scratch an itch, but you can't itch a scratch. Furthermore, an
> itch can
> itch but a scratch can't scratch. Finally, a scratch can itch, but an itch
> can't
> scratch. All together this implies: He scratched the itch from the scratch
> that
> itched but would never itch the scratch from the itch that scratched."
>--  Keith Wiley
>
> 
>
>


-- 
Nitin Pawar

Query crawls through reducer

[Keith Wiley]

The following query translates into a many-map-single-reduce job (which is 
common) and also slags through the reduce stage...it's killing the overall 
query:

select * from a where b >= 'c' order by b desc limit 100

Note that b is a partition.  What component is making the reducer heavy?  Is it 
the order by or the limit (I'm sure it's not the partition-specific where 
clause, right?)?  Are there ways to improve its performance?


Keith Wiley kwi...@keithwiley.com keithwiley.commusic.keithwiley.com

"You can scratch an itch, but you can't itch a scratch. Furthermore, an itch can
itch but a scratch can't scratch. Finally, a scratch can itch, but an itch can't
scratch. All together this implies: He scratched the itch from the scratch that
itched but would never itch the scratch from the itch that scratched."
   --  Keith Wiley

Re: HiveServer2 released in some branch

[Lefty Leverenz]

A discussion of the next Hive release date has just gotten started on
hive-dev
:

   - next hive 
release

   - initial 
replies


– Lefty



On Thu, Mar 21, 2013 at 10:52 AM, Rodrigo Trujillo <
rodrigo.truji...@linux.vnet.ibm.com> wrote:

> Hi Thejas,
>
> thank you for the explanation.
> So, HiveServer2 is going to be part of Hive 0.11, and I have read that
> HCatalog is going
> to be merged in version 0.11 too.
>
> What is the target date for Hive 0.11 ?  I searched  this information or a
> schedule, but
> did not find. Do you, or someone, know this information ? Or can point me
> to some
> schedule page, etc.
>
> Regards,
>
> Rodrigo
>
>
>
> On 03/20/2013 05:03 PM, Thejas Nair wrote:
>
>> Rodrigo,
>> New features usually go into new version (0.xx) . (0.xx.x versions are
>> usually meant for releases with bug fixes).
>> So HiveServer2 is likely to be part of next release (0.11), and not part
>> of a (0.9.x or 0.10.x) .
>> This is the usual practice that I have seen, and haven't heard of any
>> plans to contrary.
>>
>> -Thejas (not a hive PMC member/committer)
>>
>>
>>
>> On 3/20/13 6:14 AM, Rodrigo Trujillo wrote:
>>
>>>
>>> Hi all,
>>>
>>> I see that the patches for HiveServer2 are committed in the trunk.
>>> Any idea whether this feature is going to be released in current
>>> branches ( 0.9.x or 0.10.x ) ?
>>>
>>> Best regards,
>>>
>>> Rodrigo Trujillo
>>>
>>>
>>
>

Re: Not a hive question but HUE question

[Jarek Jarcec Cecho]

Hi Chalcy,
there is hue-user mailing list at [1].

Jarcec

Links:
1: https://groups.google.com/a/cloudera.org/forum/?fromgroups#!forum/hue-user

On Fri, Mar 22, 2013 at 07:13:04PM +, Chalcy Raja wrote:
> Hi fellow Hive users,
> 
> Any of you know if there is a HUE user group?
> 
> Thanks,
> Chalcy


signature.asc
Description: Digital signature

found it :) RE: Not a hive question but HUE question

[Chalcy Raja]

From: Chalcy Raja [mailto:chalcy.r...@careerbuilder.com]
Sent: Friday, March 22, 2013 3:13 PM
To: user@hive.apache.org
Subject: Not a hive question but HUE question

Hi fellow Hive users,

Any of you know if there is a HUE user group?

Thanks,
Chalcy

Not a hive question but HUE question

[Chalcy Raja]

Hi fellow Hive users,

Any of you know if there is a HUE user group?

Thanks,
Chalcy