ORC: OrcInputFormat based on old map reduce API?

2013-11-17 Thread qihua wu
It imports the classes under package of org.apache.hadoop.mapred instead
of org.apache.hadoop.mapreduce, which means it used old API. How can I run
it using new mapreduce API?


CombineFileInputFormat with un-splittable compression

2013-11-17 Thread Mungre,Surbhi
We have a m/r job which writes CSV files ranging from 10MB to 200MB. To make 
HIVE queries efficient on these files we are planning to combine small files. 
However, it looks like HIVE itself can combine small files [1]. I noticed that 
when these CSV files are compressed using SNAPPY, HIVE is not able to combine 
the small files. I am assuming since SNAPPY is not splittable for text data, 
HIVE is unable to combine these files and I am hoping when we use a splittable 
compression, HIVE will be able to combine small files. Can someone please 
confirm that CombineFileInputFormat does not work with compression which is not 
splittable?

[1] 
https://issues.apache.org/jira/browse/HIVE-74

Surbhi Mungre
Software Engineer
www.cerner.com

CONFIDENTIALITY NOTICE This message and any included attachments are from 
Cerner Corporation and are intended only for the addressee. The information 
contained in this message is confidential and may constitute inside or 
non-public information under international, federal, or state securities laws. 
Unauthorized forwarding, printing, copying, distribution, or use of such 
information is strictly prohibited and may be unlawful. If you are not the 
addressee, please promptly delete this message and notify the sender of the 
delivery error by e-mail or you may call Cerner's corporate offices in Kansas 
City, Missouri, U.S.A at (+1) (816)221-1024.


Re: [ANNOUNCE] New Hive Committer and PMC Member - Lefty Leverenz

2013-11-17 Thread Jarek Jarcec Cecho
Congratulations Lefty!

Jarcec

On Sat, Nov 16, 2013 at 09:20:00PM -0800, Carl Steinbach wrote:
> The Apache Hive PMC has voted to make Lefty Leverenz a committer and PMC
> member on the Apache Hive Project.
> 
> Please join me in congratulating Lefty!
> 
> Thanks.
> 
> Carl


signature.asc
Description: Digital signature


Re: [ANNOUNCE] New Hive Committer and PMC Member - Lefty Leverenz

2013-11-17 Thread Prasanth J (Official)
Congratulations Lefty!!

Thanks
Prasanth J

On Nov 17, 2013, at 12:18 AM, Gunther Hagleitner  
wrote:

> Congrats Lefty!
> 
> Thanks,
> Gunther.
> 
> 
> On Sun, Nov 17, 2013 at 12:09 AM, Vaibhav Gumashta 
>  wrote:
> Awesome! Congrats Lefty!
> 
> 
> On Sun, Nov 17, 2013 at 12:06 AM, Thejas Nair wrote:
> 
> > Congrats Lefty!
> >
> >
> > On Sat, Nov 16, 2013 at 9:20 PM, Carl Steinbach  wrote:
> > > The Apache Hive PMC has voted to make Lefty Leverenz a committer and PMC
> > > member on the Apache Hive Project.
> > >
> > > Please join me in congratulating Lefty!
> > >
> > > Thanks.
> > >
> > > Carl
> >
> > --
> > CONFIDENTIALITY NOTICE
> > NOTICE: This message is intended for the use of the individual or entity to
> > which it is addressed and may contain information that is confidential,
> > privileged and exempt from disclosure under applicable law. If the reader
> > of this message is not the intended recipient, you are hereby notified that
> > any printing, copying, dissemination, distribution, disclosure or
> > forwarding of this communication is strictly prohibited. If you have
> > received this communication in error, please contact the sender immediately
> > and delete it from your system. Thank You.
> >
> 
> --
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or entity to
> which it is addressed and may contain information that is confidential,
> privileged and exempt from disclosure under applicable law. If the reader
> of this message is not the intended recipient, you are hereby notified that
> any printing, copying, dissemination, distribution, disclosure or
> forwarding of this communication is strictly prohibited. If you have
> received this communication in error, please contact the sender immediately
> and delete it from your system. Thank You.
> 
> 
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or entity to 
> which it is addressed and may contain information that is confidential, 
> privileged and exempt from disclosure under applicable law. If the reader of 
> this message is not the intended recipient, you are hereby notified that any 
> printing, copying, dissemination, distribution, disclosure or forwarding of 
> this communication is strictly prohibited. If you have received this 
> communication in error, please contact the sender immediately and delete it 
> from your system. Thank You.


-- 
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to 
which it is addressed and may contain information that is confidential, 
privileged and exempt from disclosure under applicable law. If the reader 
of this message is not the intended recipient, you are hereby notified that 
any printing, copying, dissemination, distribution, disclosure or 
forwarding of this communication is strictly prohibited. If you have 
received this communication in error, please contact the sender immediately 
and delete it from your system. Thank You.


Re: [ANNOUNCE] New Hive Committer and PMC Member - Lefty Leverenz

2013-11-17 Thread Gunther Hagleitner
Congrats Lefty!

Thanks,
Gunther.


On Sun, Nov 17, 2013 at 12:09 AM, Vaibhav Gumashta <
vgumas...@hortonworks.com> wrote:

> Awesome! Congrats Lefty!
>
>
> On Sun, Nov 17, 2013 at 12:06 AM, Thejas Nair  >wrote:
>
> > Congrats Lefty!
> >
> >
> > On Sat, Nov 16, 2013 at 9:20 PM, Carl Steinbach  wrote:
> > > The Apache Hive PMC has voted to make Lefty Leverenz a committer and
> PMC
> > > member on the Apache Hive Project.
> > >
> > > Please join me in congratulating Lefty!
> > >
> > > Thanks.
> > >
> > > Carl
> >
> > --
> > CONFIDENTIALITY NOTICE
> > NOTICE: This message is intended for the use of the individual or entity
> to
> > which it is addressed and may contain information that is confidential,
> > privileged and exempt from disclosure under applicable law. If the reader
> > of this message is not the intended recipient, you are hereby notified
> that
> > any printing, copying, dissemination, distribution, disclosure or
> > forwarding of this communication is strictly prohibited. If you have
> > received this communication in error, please contact the sender
> immediately
> > and delete it from your system. Thank You.
> >
>
> --
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or entity to
> which it is addressed and may contain information that is confidential,
> privileged and exempt from disclosure under applicable law. If the reader
> of this message is not the intended recipient, you are hereby notified that
> any printing, copying, dissemination, distribution, disclosure or
> forwarding of this communication is strictly prohibited. If you have
> received this communication in error, please contact the sender immediately
> and delete it from your system. Thank You.
>

-- 
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to 
which it is addressed and may contain information that is confidential, 
privileged and exempt from disclosure under applicable law. If the reader 
of this message is not the intended recipient, you are hereby notified that 
any printing, copying, dissemination, distribution, disclosure or 
forwarding of this communication is strictly prohibited. If you have 
received this communication in error, please contact the sender immediately 
and delete it from your system. Thank You.


Re: [ANNOUNCE] New Hive Committer and PMC Member - Lefty Leverenz

2013-11-17 Thread Vaibhav Gumashta
Awesome! Congrats Lefty!


On Sun, Nov 17, 2013 at 12:06 AM, Thejas Nair wrote:

> Congrats Lefty!
>
>
> On Sat, Nov 16, 2013 at 9:20 PM, Carl Steinbach  wrote:
> > The Apache Hive PMC has voted to make Lefty Leverenz a committer and PMC
> > member on the Apache Hive Project.
> >
> > Please join me in congratulating Lefty!
> >
> > Thanks.
> >
> > Carl
>
> --
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or entity to
> which it is addressed and may contain information that is confidential,
> privileged and exempt from disclosure under applicable law. If the reader
> of this message is not the intended recipient, you are hereby notified that
> any printing, copying, dissemination, distribution, disclosure or
> forwarding of this communication is strictly prohibited. If you have
> received this communication in error, please contact the sender immediately
> and delete it from your system. Thank You.
>

-- 
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to 
which it is addressed and may contain information that is confidential, 
privileged and exempt from disclosure under applicable law. If the reader 
of this message is not the intended recipient, you are hereby notified that 
any printing, copying, dissemination, distribution, disclosure or 
forwarding of this communication is strictly prohibited. If you have 
received this communication in error, please contact the sender immediately 
and delete it from your system. Thank You.


Re: [ANNOUNCE] New Hive Committer and PMC Member - Lefty Leverenz

2013-11-17 Thread Thejas Nair
Congrats Lefty!


On Sat, Nov 16, 2013 at 9:20 PM, Carl Steinbach  wrote:
> The Apache Hive PMC has voted to make Lefty Leverenz a committer and PMC
> member on the Apache Hive Project.
>
> Please join me in congratulating Lefty!
>
> Thanks.
>
> Carl

-- 
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to 
which it is addressed and may contain information that is confidential, 
privileged and exempt from disclosure under applicable law. If the reader 
of this message is not the intended recipient, you are hereby notified that 
any printing, copying, dissemination, distribution, disclosure or 
forwarding of this communication is strictly prohibited. If you have 
received this communication in error, please contact the sender immediately 
and delete it from your system. Thank You.