Re: Editing hive wiki?

2014-09-19 Thread Lefty Leverenz
>
> I think the sun sets in west coast. :)
>

lol!

So why do we have an "Edit Profile" button if we can't edit our profiles?
 And why doesn't the red message have a link to the Infra JIRA?  Room for
improvement here.

-- Lefty

On Fri, Sep 19, 2014 at 7:01 PM, Xuefu Zhang  wrote:

> I saw the same red warning message when I tried to edit mine. Sorry.
>
> On Fri, Sep 19, 2014 at 2:43 PM, pratik khadloya 
> wrote:
>
>> I edited the doc, but looks like i cannot edit my own profile.
>>
>> You cannot change your Profile, this is disabled.
>> If you need to change anything contact the Infra Team.
>>
>> Can this be enabled?
>>
>> ~Pratik
>>
>> On Fri, Sep 19, 2014 at 2:28 PM, Xuefu Zhang  wrote:
>>
>>> Done for tispratik.
>>>
>>> BTW, @Lefty, I think the sun sets in west coast. :)
>>>
>>> On Fri, Sep 19, 2014 at 2:12 PM, pratik khadloya 
>>> wrote:
>>>
 Sorry, forgot to mention it previously. It is "tispratik".

 Thanks,
 Pratik

 On Fri, Sep 19, 2014 at 2:02 PM, Lefty Leverenz <
 leftylever...@gmail.com> wrote:

> What's your Confluence username?
>
> I'm going out for a bike ride before the sun sets (East Coast) so if
> somebody else wants to take care of this in the meantime -- go for it.
>  Otherwise I'll do it later tonight.
>
> -- Lefty
>
> On Fri, Sep 19, 2014 at 4:52 PM, pratik khadloya 
> wrote:
>
>> Thanks Lefty. Can you provide write access to the wiki, seems like
>> that is the first step based on the wiki.
>>
>> ~Pratik
>>
>> On Fri, Sep 19, 2014 at 1:08 PM, Lefty Leverenz <
>> leftylever...@gmail.com> wrote:
>>
>>> It's easy, here are the instructions:  AboutThisWiki – How to get
>>> permission to edit
>>> 
>>> .
>>>
>>> Details about how to edit are here:  HIVE-7142 comment about how to
>>> edit the wiki
>>> 
>>> .
>>>
>>> -- Lefty
>>>
>>>
>>> On Fri, Sep 19, 2014 at 1:05 PM, pratik khadloya <
>>> tispra...@gmail.com> wrote:
>>>
 Hello,

 How do i get permission or add comments to pages in hive wiki?
 Mainly i would like to edit
 https://cwiki.apache.org/confluence/display/Hive/Parquet and add
 that hive has native support for parquet "but not all data types are
 supported yet". We can also mention HIVE-6384
   with it.

 Thanks,
 ~Pratik

>>>
>>>
>>
>

>>>
>>
>


Re: Editing hive wiki?

2014-09-19 Thread Xuefu Zhang
I saw the same red warning message when I tried to edit mine. Sorry.

On Fri, Sep 19, 2014 at 2:43 PM, pratik khadloya 
wrote:

> I edited the doc, but looks like i cannot edit my own profile.
>
> You cannot change your Profile, this is disabled.
> If you need to change anything contact the Infra Team.
>
> Can this be enabled?
>
> ~Pratik
>
> On Fri, Sep 19, 2014 at 2:28 PM, Xuefu Zhang  wrote:
>
>> Done for tispratik.
>>
>> BTW, @Lefty, I think the sun sets in west coast. :)
>>
>> On Fri, Sep 19, 2014 at 2:12 PM, pratik khadloya 
>> wrote:
>>
>>> Sorry, forgot to mention it previously. It is "tispratik".
>>>
>>> Thanks,
>>> Pratik
>>>
>>> On Fri, Sep 19, 2014 at 2:02 PM, Lefty Leverenz >> > wrote:
>>>
 What's your Confluence username?

 I'm going out for a bike ride before the sun sets (East Coast) so if
 somebody else wants to take care of this in the meantime -- go for it.
  Otherwise I'll do it later tonight.

 -- Lefty

 On Fri, Sep 19, 2014 at 4:52 PM, pratik khadloya 
 wrote:

> Thanks Lefty. Can you provide write access to the wiki, seems like
> that is the first step based on the wiki.
>
> ~Pratik
>
> On Fri, Sep 19, 2014 at 1:08 PM, Lefty Leverenz <
> leftylever...@gmail.com> wrote:
>
>> It's easy, here are the instructions:  AboutThisWiki – How to get
>> permission to edit
>> 
>> .
>>
>> Details about how to edit are here:  HIVE-7142 comment about how to
>> edit the wiki
>> 
>> .
>>
>> -- Lefty
>>
>>
>> On Fri, Sep 19, 2014 at 1:05 PM, pratik khadloya > > wrote:
>>
>>> Hello,
>>>
>>> How do i get permission or add comments to pages in hive wiki?
>>> Mainly i would like to edit
>>> https://cwiki.apache.org/confluence/display/Hive/Parquet and add
>>> that hive has native support for parquet "but not all data types are
>>> supported yet". We can also mention HIVE-6384
>>>   with it.
>>>
>>> Thanks,
>>> ~Pratik
>>>
>>
>>
>

>>>
>>
>


Re: Editing hive wiki?

2014-09-19 Thread pratik khadloya
I edited the doc, but looks like i cannot edit my own profile.

You cannot change your Profile, this is disabled.
If you need to change anything contact the Infra Team.

Can this be enabled?

~Pratik

On Fri, Sep 19, 2014 at 2:28 PM, Xuefu Zhang  wrote:

> Done for tispratik.
>
> BTW, @Lefty, I think the sun sets in west coast. :)
>
> On Fri, Sep 19, 2014 at 2:12 PM, pratik khadloya 
> wrote:
>
>> Sorry, forgot to mention it previously. It is "tispratik".
>>
>> Thanks,
>> Pratik
>>
>> On Fri, Sep 19, 2014 at 2:02 PM, Lefty Leverenz 
>> wrote:
>>
>>> What's your Confluence username?
>>>
>>> I'm going out for a bike ride before the sun sets (East Coast) so if
>>> somebody else wants to take care of this in the meantime -- go for it.
>>>  Otherwise I'll do it later tonight.
>>>
>>> -- Lefty
>>>
>>> On Fri, Sep 19, 2014 at 4:52 PM, pratik khadloya 
>>> wrote:
>>>
 Thanks Lefty. Can you provide write access to the wiki, seems like that
 is the first step based on the wiki.

 ~Pratik

 On Fri, Sep 19, 2014 at 1:08 PM, Lefty Leverenz <
 leftylever...@gmail.com> wrote:

> It's easy, here are the instructions:  AboutThisWiki – How to get
> permission to edit
> 
> .
>
> Details about how to edit are here:  HIVE-7142 comment about how to
> edit the wiki
> 
> .
>
> -- Lefty
>
>
> On Fri, Sep 19, 2014 at 1:05 PM, pratik khadloya 
> wrote:
>
>> Hello,
>>
>> How do i get permission or add comments to pages in hive wiki?
>> Mainly i would like to edit
>> https://cwiki.apache.org/confluence/display/Hive/Parquet and add
>> that hive has native support for parquet "but not all data types are
>> supported yet". We can also mention HIVE-6384
>>   with it.
>>
>> Thanks,
>> ~Pratik
>>
>
>

>>>
>>
>


Re: UDF for MONTHS_BETWEEN

2014-09-19 Thread Jason Dere
I don't think there such a function yet in Hive.

On Sep 19, 2014, at 2:23 PM, Binal Jhaveri  wrote:

> 
> Is there currently a Hive UDF to mimic the Oracle function MONTHS_BETWEEN??
> 


-- 
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to 
which it is addressed and may contain information that is confidential, 
privileged and exempt from disclosure under applicable law. If the reader 
of this message is not the intended recipient, you are hereby notified that 
any printing, copying, dissemination, distribution, disclosure or 
forwarding of this communication is strictly prohibited. If you have 
received this communication in error, please contact the sender immediately 
and delete it from your system. Thank You.


Re: Editing hive wiki?

2014-09-19 Thread Xuefu Zhang
Done for tispratik.

BTW, @Lefty, I think the sun sets in west coast. :)

On Fri, Sep 19, 2014 at 2:12 PM, pratik khadloya 
wrote:

> Sorry, forgot to mention it previously. It is "tispratik".
>
> Thanks,
> Pratik
>
> On Fri, Sep 19, 2014 at 2:02 PM, Lefty Leverenz 
> wrote:
>
>> What's your Confluence username?
>>
>> I'm going out for a bike ride before the sun sets (East Coast) so if
>> somebody else wants to take care of this in the meantime -- go for it.
>>  Otherwise I'll do it later tonight.
>>
>> -- Lefty
>>
>> On Fri, Sep 19, 2014 at 4:52 PM, pratik khadloya 
>> wrote:
>>
>>> Thanks Lefty. Can you provide write access to the wiki, seems like that
>>> is the first step based on the wiki.
>>>
>>> ~Pratik
>>>
>>> On Fri, Sep 19, 2014 at 1:08 PM, Lefty Leverenz >> > wrote:
>>>
 It's easy, here are the instructions:  AboutThisWiki – How to get
 permission to edit
 
 .

 Details about how to edit are here:  HIVE-7142 comment about how to
 edit the wiki
 
 .

 -- Lefty


 On Fri, Sep 19, 2014 at 1:05 PM, pratik khadloya 
 wrote:

> Hello,
>
> How do i get permission or add comments to pages in hive wiki?
> Mainly i would like to edit
> https://cwiki.apache.org/confluence/display/Hive/Parquet and add that
> hive has native support for parquet "but not all data types are supported
> yet". We can also mention HIVE-6384
>   with it.
>
> Thanks,
> ~Pratik
>


>>>
>>
>


Fwd: UDF for MONTHS_BETWEEN

2014-09-19 Thread Binal Jhaveri
Is there currently a Hive UDF to mimic the Oracle function MONTHS_BETWEEN??


Re: Editing hive wiki?

2014-09-19 Thread pratik khadloya
Sorry, forgot to mention it previously. It is "tispratik".

Thanks,
Pratik

On Fri, Sep 19, 2014 at 2:02 PM, Lefty Leverenz 
wrote:

> What's your Confluence username?
>
> I'm going out for a bike ride before the sun sets (East Coast) so if
> somebody else wants to take care of this in the meantime -- go for it.
>  Otherwise I'll do it later tonight.
>
> -- Lefty
>
> On Fri, Sep 19, 2014 at 4:52 PM, pratik khadloya 
> wrote:
>
>> Thanks Lefty. Can you provide write access to the wiki, seems like that
>> is the first step based on the wiki.
>>
>> ~Pratik
>>
>> On Fri, Sep 19, 2014 at 1:08 PM, Lefty Leverenz 
>> wrote:
>>
>>> It's easy, here are the instructions:  AboutThisWiki – How to get
>>> permission to edit
>>> 
>>> .
>>>
>>> Details about how to edit are here:  HIVE-7142 comment about how to
>>> edit the wiki
>>> 
>>> .
>>>
>>> -- Lefty
>>>
>>>
>>> On Fri, Sep 19, 2014 at 1:05 PM, pratik khadloya 
>>> wrote:
>>>
 Hello,

 How do i get permission or add comments to pages in hive wiki?
 Mainly i would like to edit
 https://cwiki.apache.org/confluence/display/Hive/Parquet and add that
 hive has native support for parquet "but not all data types are supported
 yet". We can also mention HIVE-6384
   with it.

 Thanks,
 ~Pratik

>>>
>>>
>>
>


Re: Editing hive wiki?

2014-09-19 Thread Lefty Leverenz
What's your Confluence username?

I'm going out for a bike ride before the sun sets (East Coast) so if
somebody else wants to take care of this in the meantime -- go for it.
 Otherwise I'll do it later tonight.

-- Lefty

On Fri, Sep 19, 2014 at 4:52 PM, pratik khadloya 
wrote:

> Thanks Lefty. Can you provide write access to the wiki, seems like that is
> the first step based on the wiki.
>
> ~Pratik
>
> On Fri, Sep 19, 2014 at 1:08 PM, Lefty Leverenz 
> wrote:
>
>> It's easy, here are the instructions:  AboutThisWiki – How to get
>> permission to edit
>> 
>> .
>>
>> Details about how to edit are here:  HIVE-7142 comment about how to edit
>> the wiki
>> 
>> .
>>
>> -- Lefty
>>
>>
>> On Fri, Sep 19, 2014 at 1:05 PM, pratik khadloya 
>> wrote:
>>
>>> Hello,
>>>
>>> How do i get permission or add comments to pages in hive wiki?
>>> Mainly i would like to edit
>>> https://cwiki.apache.org/confluence/display/Hive/Parquet and add that
>>> hive has native support for parquet "but not all data types are supported
>>> yet". We can also mention HIVE-6384
>>>   with it.
>>>
>>> Thanks,
>>> ~Pratik
>>>
>>
>>
>


Re: Editing hive wiki?

2014-09-19 Thread pratik khadloya
Thanks Lefty. Can you provide write access to the wiki, seems like that is
the first step based on the wiki.

~Pratik

On Fri, Sep 19, 2014 at 1:08 PM, Lefty Leverenz 
wrote:

> It's easy, here are the instructions:  AboutThisWiki – How to get
> permission to edit
> 
> .
>
> Details about how to edit are here:  HIVE-7142 comment about how to edit
> the wiki
> 
> .
>
> -- Lefty
>
>
> On Fri, Sep 19, 2014 at 1:05 PM, pratik khadloya 
> wrote:
>
>> Hello,
>>
>> How do i get permission or add comments to pages in hive wiki?
>> Mainly i would like to edit
>> https://cwiki.apache.org/confluence/display/Hive/Parquet and add that
>> hive has native support for parquet "but not all data types are supported
>> yet". We can also mention HIVE-6384
>>   with it.
>>
>> Thanks,
>> ~Pratik
>>
>
>


Re: Editing hive wiki?

2014-09-19 Thread Lefty Leverenz
It's easy, here are the instructions:  AboutThisWiki – How to get
permission to edit

.

Details about how to edit are here:  HIVE-7142 comment about how to edit
the wiki

.

-- Lefty


On Fri, Sep 19, 2014 at 1:05 PM, pratik khadloya 
wrote:

> Hello,
>
> How do i get permission or add comments to pages in hive wiki?
> Mainly i would like to edit
> https://cwiki.apache.org/confluence/display/Hive/Parquet and add that
> hive has native support for parquet "but not all data types are supported
> yet". We can also mention HIVE-6384
>   with it.
>
> Thanks,
> ~Pratik
>


Re: ArrayWritableGroupConverter

2014-09-19 Thread Raymond Lau
Anyone know anything about this?  We have our errors stored in this data
structure, so it's hard to debug when we can't analyze our errors :\

Shameless bump.

On Thu, Aug 14, 2014 at 10:43 AM, Raymond Lau  wrote:

> Original Thrift schema:
>
> struct teststruct {
>   1: optional string field1;
>   2: optional string field2;
>   3: optional string field3;
> }
>
> struct mainstruct {
>   1: optional list teststructs;
> }
>
> This parquet file schema was generated:
>
> message ParquetSchema {
>   optional group teststructs {
> repeated group teststruct_tuple {
>   optional binary field1;
>   optional binary field2;
>   optional binary field3;
> }
>   }
> }
>
> When i try to run queries involving this 'teststructs' column, I get this
> error:
>
> Failed with exception java.io.IOException:java.lang.RuntimeException:
> Invalid parquet hive schema: repeated group teststruct_tuple {
>   optional binary field1;
>   optional binary field2;
>   optional binary field3;
> }
>
>
>
> On Thu, Aug 14, 2014 at 8:35 AM, Brock Noland  wrote:
>
>> Hi,
>>
>> Can you share your parquet schema?
>>
>> Brock
>>
>>
>> On Tue, Aug 12, 2014 at 5:06 PM, Raymond Lau 
>> wrote:
>>
>>> Hello.  (First off, sorry if I accidentally posted to the wrong mailing
>>> list before - dev - and you are getting this again)
>>>
>>> Regarding the ArrayWritableGroupConverter class: I was just wondering
>>> how come the field count has to be either 1 or 2?  I'm trying to read a
>>> column where the amount is fields is 3 and I'm getting an invalid parquet
>>> hive schema (in hive 0.12) error when I try to do so.  It looks like it
>>> links back to here.
>>>
>>> *https://github.com/apache/hive/blob/trunk/ql/src/java/org/apache/hadoop/hive/ql/io/parquet/convert/ArrayWritableGroupConverter.java
>>> *
>>>
>>>
>>> Thanks,
>>> -Raymond
>>>
>>
>>
>
>
> --
> *Raymond Lau*
> Software Engineer - Intern |
> r...@ooyala.com | (925) 395-3806
>



-- 
*Raymond Lau*
Software Engineer - Intern |
r...@ooyala.com | (925) 395-3806


Editing hive wiki?

2014-09-19 Thread pratik khadloya
Hello,

How do i get permission or add comments to pages in hive wiki?
Mainly i would like to edit
https://cwiki.apache.org/confluence/display/Hive/Parquet and add that hive
has native support for parquet "but not all data types are supported yet".
We can also mention HIVE-6384
  with it.

Thanks,
~Pratik


audit hive query

2014-09-19 Thread siva kumar
Hi All,
  I have a requirement to view the recently executed Hive queries
in sql. I have configured sql as metastore to hive and im able to view hive
tables,columns,partitions in sql . Simillarly,i need to view the hive
queries executed on hive data.



Any help is appreciated,
sivakumar.c