Re: Would like to be a user

[Lefty Leverenz]

Suresh, you now have write privileges for the Hive wiki.  Welcome to the
docs team!

-- Lefty



On Tue, May 17, 2016 at 3:36 PM, Markovitz, Dudu 
wrote:

> Thanks J
>
>
>
> *From:* Lefty Leverenz [mailto:leftylever...@gmail.com]
> *Sent:* Tuesday, May 17, 2016 10:06 PM
>
> *To:* user@hive.apache.org
> *Subject:* Re: Would like to be a user
>
>
>
> Done.  Welcome to the Hive wiki team, Dudu!
>
>
> -- Lefty
>
>
>
>
>
> On Tue, May 17, 2016 at 3:04 AM, Markovitz, Dudu 
> wrote:
>
> Hi Lefty
>
>
>
> Can you add me as well?
>
> My user is dudu.markovitz
>
>
>
> Thanks
>
>
>
> Dudu
>
>
>
> *From:* Lefty Leverenz [mailto:leftylever...@gmail.com]
> *Sent:* Monday, May 16, 2016 11:44 PM
> *To:* user@hive.apache.org
> *Subject:* Re: Would like to be a user
>
>
>
> Welcome Gail, I've given you write access to the Hive wiki.  Thanks in
> advance for your contributions!
>
>
> -- Lefty
>
>
>
> On Mon, May 16, 2016 at 4:39 PM, gail haspert  wrote:
>
> Hi
>
> I would like to start working on (write to) apache hive. My confluence
> user name is ghaspert.
>
>
>
> thanks
>
> -- Forwarded message --
> From: *gail haspert* 
> Date: Mon, May 16, 2016 at 12:40 PM
> Subject: Would like to be a user
> To: user-subscr...@hive.apache.org
>
> I just signed up as ghaspert for a confluence account.
>
> Thanks,
>
> Gail
>
>
>
>
>
>
>

Re: Query Failing while querying on ORC Format

[mahender bigdata]

Thanks Mich.


On 5/17/2016 1:31 PM, Mich Talebzadeh wrote:
I am afraid AFAIK the old partitions cannot be modified as they are 
fixed in size. That is the existing partition file.


I agree this is very tedious. We should come up with a more flexible 
design for ORC tables.


HTH

Dr Mich Talebzadeh

LinkedIn 
/https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw/


http://talebzadehmich.wordpress.com 


On 17 May 2016 at 21:20, mahender bigdata 
> 
wrote:


Hi Jorn,

You mean to say try to add additional columns for the old
partitions where column are missing ?



On 5/17/2016 7:25 AM, Jörn Franke wrote:

I do not remember exactly, but I think it worked simply by adding
a new partition to the old table with the additional columns.

On 17 May 2016, at 15:00, Mich Talebzadeh
> wrote:


Hi Mahendar,

That version 1.2 is reasonable.

One alternative is to create a new table (new_table) in Hive
with columns from old_table plus the added column new_column as
ORC etc

Do an INSERT/SELECT from old_table to new_table

INSERT INTO new_table
SELECT *, > wrote:

I'm on Hive 1.2


On 5/16/2016 12:02 PM, Matthew McCline wrote:


​

What version of Hive are you on?



*From:* Mahender Sarangam 

*Sent:* Saturday, May 14, 2016 3:29 PM
*To:* user@hive.apache.org 
*Subject:* Query Failing while querying on ORC Format
Hi,
We are dumping our data into ORC Partition Bucketed table.
We have loaded almost 6 months data and here month is
Partition by column. Now we have modified ORC partition
bucketed table schema. We have added 2 more columns to
the ORC table. Now whenever we are running select statement
for older month which has no columns( even though these
columns are not part in select clause, (projection
column) ), it is throwing exception.

There is JIRA bug for this kind of requirement has already
been raised.
https://issues.apache.org/jira/browse/HIVE-11981

Can any one please tell me know alternative workaround for
reading old previous columns of ORC partition table.

Thanks

Re: Query Failing while querying on ORC Format

[Mich Talebzadeh]

I am afraid AFAIK the old partitions cannot be modified as they are fixed
in size. That is the existing partition file.

I agree this is very tedious. We should come up with a more flexible design
for ORC tables.

HTH

Dr Mich Talebzadeh



LinkedIn * 
https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw
*



http://talebzadehmich.wordpress.com



On 17 May 2016 at 21:20, mahender bigdata 
wrote:

> Hi Jorn,
>
> You mean to say try to add additional columns for the old partitions where
> column are missing ?
>
>
>
> On 5/17/2016 7:25 AM, Jörn Franke wrote:
>
> I do not remember exactly, but I think it worked simply by adding a new
> partition to the old table with the additional columns.
>
> On 17 May 2016, at 15:00, Mich Talebzadeh 
> wrote:
>
> Hi Mahendar,
>
> That version 1.2 is reasonable.
>
> One alternative is to create a new table (new_table) in Hive with columns
> from old_table plus the added column new_column as ORC etc
>
> Do an INSERT/SELECT from old_table to new_table
>
> INSERT INTO new_table
> SELECT *,  ALTER old_table RENAME to old_table_KEEP
> RENAME new_table TO ol_table
>
> That should work. Check the syntax.
>
> HTH
>
> Dr Mich Talebzadeh
>
>
>
> LinkedIn *
> https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw
> *
>
>
>
> http://talebzadehmich.wordpress.com
>
>
>
> On 16 May 2016 at 23:53, mahender bigdata 
> wrote:
>
>> I'm on Hive 1.2
>>
>> On 5/16/2016 12:02 PM, Matthew McCline wrote:
>>
>> ​
>>
>> What version of Hive are you on?
>>
>>
>> --
>> *From:* Mahender Sarangam 
>> 
>> *Sent:* Saturday, May 14, 2016 3:29 PM
>> *To:* user@hive.apache.org
>> *Subject:* Query Failing while querying on ORC Format
>>
>> Hi,
>> We are dumping our data into ORC Partition Bucketed table. We have loaded
>> almost 6 months data and here month is Partition by column. Now we have
>> modified ORC partition bucketed table schema. We have added 2 more columns
>> to the ORC table. Now whenever we are running select statement for older
>> month which has no columns( even though these columns are not part in
>> select clause, (projection column) ), it is throwing exception.
>>
>> There is JIRA bug for this kind of requirement has already been raised.
>> https://issues.apache.org/jira/browse/HIVE-11981
>>
>> Can any one please tell me know alternative workaround for reading old
>> previous columns of ORC partition table.
>>
>> Thanks
>>
>>
>>
>
>

Re: Query Failing while querying on ORC Format

[mahender bigdata]

Hi Jorn,

You mean to say try to add additional columns for the old partitions 
where column are missing ?




On 5/17/2016 7:25 AM, Jörn Franke wrote:
I do not remember exactly, but I think it worked simply by adding a 
new partition to the old table with the additional columns.


On 17 May 2016, at 15:00, Mich Talebzadeh > wrote:



Hi Mahendar,

That version 1.2 is reasonable.

One alternative is to create a new table (new_table) in Hive with 
columns from old_table plus the added column new_column as ORC etc


Do an INSERT/SELECT from old_table to new_table

INSERT INTO new_table
SELECT *, 



On 16 May 2016 at 23:53, mahender bigdata 
> 
wrote:


I'm on Hive 1.2


On 5/16/2016 12:02 PM, Matthew McCline wrote:


​

What version of Hive are you on?



*From:* Mahender Sarangam 

*Sent:* Saturday, May 14, 2016 3:29 PM
*To:* user@hive.apache.org 
*Subject:* Query Failing while querying on ORC Format
Hi,
We are dumping our data into ORC Partition Bucketed table. We
have loaded almost 6 months data and here month is Partition by
column. Now we have modified ORC partition bucketed table
schema. We have added 2 more columns to the ORC table. Now
whenever we are running select statement for older month which
has no columns( even though these columns are not part in select
clause, (projection column) ), it is throwing exception.

There is JIRA bug for this kind of requirement has already been
raised.
https://issues.apache.org/jira/browse/HIVE-11981

Can any one please tell me know alternative workaround for
reading old previous columns of ORC partition table.

Thanks

RE: Would like to be a user

[Markovitz, Dudu]

Thanks ☺

From: Lefty Leverenz [mailto:leftylever...@gmail.com]
Sent: Tuesday, May 17, 2016 10:06 PM
To: user@hive.apache.org
Subject: Re: Would like to be a user

Done.  Welcome to the Hive wiki team, Dudu!

-- Lefty


On Tue, May 17, 2016 at 3:04 AM, Markovitz, Dudu 
> wrote:
Hi Lefty

Can you add me as well?
My user is dudu.markovitz

Thanks

Dudu

From: Lefty Leverenz 
[mailto:leftylever...@gmail.com]
Sent: Monday, May 16, 2016 11:44 PM
To: user@hive.apache.org
Subject: Re: Would like to be a user

Welcome Gail, I've given you write access to the Hive wiki.  Thanks in advance 
for your contributions!

-- Lefty

On Mon, May 16, 2016 at 4:39 PM, gail haspert 
> wrote:
Hi
I would like to start working on (write to) apache hive. My confluence user 
name is ghaspert.

thanks
-- Forwarded message --
From: gail haspert >
Date: Mon, May 16, 2016 at 12:40 PM
Subject: Would like to be a user
To: user-subscr...@hive.apache.org
I just signed up as ghaspert for a confluence account.
Thanks,
Gail

Re: Would like to be a user

[Lefty Leverenz]

Done.  Welcome to the Hive wiki team, Dudu!

-- Lefty


On Tue, May 17, 2016 at 3:04 AM, Markovitz, Dudu 
wrote:

> Hi Lefty
>
>
>
> Can you add me as well?
>
> My user is dudu.markovitz
>
>
>
> Thanks
>
>
>
> Dudu
>
>
>
> *From:* Lefty Leverenz [mailto:leftylever...@gmail.com]
> *Sent:* Monday, May 16, 2016 11:44 PM
> *To:* user@hive.apache.org
> *Subject:* Re: Would like to be a user
>
>
>
> Welcome Gail, I've given you write access to the Hive wiki.  Thanks in
> advance for your contributions!
>
>
> -- Lefty
>
>
>
> On Mon, May 16, 2016 at 4:39 PM, gail haspert  wrote:
>
> Hi
>
> I would like to start working on (write to) apache hive. My confluence
> user name is ghaspert.
>
>
>
> thanks
>
> -- Forwarded message --
> From: *gail haspert* 
> Date: Mon, May 16, 2016 at 12:40 PM
> Subject: Would like to be a user
> To: user-subscr...@hive.apache.org
>
> I just signed up as ghaspert for a confluence account.
>
> Thanks,
>
> Gail
>
>
>
>
>

Re: Query Failing while querying on ORC Format

[mahender bigdata]

Thanks Mich. Reloading will always be there.  My only worry point is, we 
need to move 10 years of data and just looking for workaround without 
reloading.


/Mahender


On 5/17/2016 6:00 AM, Mich Talebzadeh wrote:

Hi Mahendar,

That version 1.2 is reasonable.

One alternative is to create a new table (new_table) in Hive with 
columns from old_table plus the added column new_column as ORC etc


Do an INSERT/SELECT from old_table to new_table

INSERT INTO new_table
SELECT *, 


On 16 May 2016 at 23:53, mahender bigdata 
> 
wrote:


I'm on Hive 1.2


On 5/16/2016 12:02 PM, Matthew McCline wrote:


​

What version of Hive are you on?



*From:* Mahender Sarangam 

*Sent:* Saturday, May 14, 2016 3:29 PM
*To:* user@hive.apache.org 
*Subject:* Query Failing while querying on ORC Format
Hi,
We are dumping our data into ORC Partition Bucketed table. We
have loaded almost 6 months data and here month is Partition by
column. Now we have modified ORC partition bucketed table schema.
We have added 2 more columns to the ORC table. Now whenever we
are running select statement for older month which has no
columns( even though these columns are not part in select clause,
(projection column) ), it is throwing exception.

There is JIRA bug for this kind of requirement has already been
raised.
https://issues.apache.org/jira/browse/HIVE-11981

Can any one please tell me know alternative workaround for
reading old previous columns of ORC partition table.

Thanks

Re: Query Failing while querying on ORC Format

[Jörn Franke]

I do not remember exactly, but I think it worked simply by adding a new 
partition to the old table with the additional columns.

> On 17 May 2016, at 15:00, Mich Talebzadeh  wrote:
> 
> Hi Mahendar,
> 
> That version 1.2 is reasonable.
> 
> One alternative is to create a new table (new_table) in Hive with columns 
> from old_table plus the added column new_column as ORC etc
> 
> Do an INSERT/SELECT from old_table to new_table
> 
> INSERT INTO new_table
> SELECT *,  ALTER old_table RENAME to old_table_KEEP
> RENAME new_table TO ol_table
> 
> That should work. Check the syntax.
> 
> HTH
> 
> Dr Mich Talebzadeh
>  
> LinkedIn  
> https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw
>  
> http://talebzadehmich.wordpress.com
>  
> 
>> On 16 May 2016 at 23:53, mahender bigdata  
>> wrote:
>> I'm on Hive 1.2
>> 
>>> On 5/16/2016 12:02 PM, Matthew McCline   wrote:
>>> ​
>>> What version of Hive are you on?
>>> 
>>> From: Mahender Sarangam 
>>> Sent: Saturday, May 14, 2016 3:29 PM
>>> To: user@hive.apache.org
>>> Subject: Query Failing while querying on ORC Format
>>>  
>>> Hi,
>>> We are dumping our data into ORC Partition Bucketed table. We have loaded 
>>> almost 6 months data and here month is Partition by column. Now we have 
>>> modified ORC partition bucketed table schema. We have added 2 more columns 
>>> to the ORC table. Now whenever we are running select statement for older 
>>> month which has no columns( even though these columns are not 
>>> part in select clause, (projection column) ), it is throwing exception.
>>>  
>>> There is JIRA bug for this kind of requirement has already been raised.
>>> https://issues.apache.org/jira/browse/HIVE-11981
>>>  
>>> Can any one please tell me know alternative workaround for reading old 
>>> previous columns of ORC partition table.
>>>  
>>> Thanks
> 

Re: Query Failing while querying on ORC Format

[Mich Talebzadeh]

Hi Mahendar,

That version 1.2 is reasonable.

One alternative is to create a new table (new_table) in Hive with columns
from old_table plus the added column new_column as ORC etc

Do an INSERT/SELECT from old_table to new_table

INSERT INTO new_table
SELECT *, *



http://talebzadehmich.wordpress.com



On 16 May 2016 at 23:53, mahender bigdata 
wrote:

> I'm on Hive 1.2
>
> On 5/16/2016 12:02 PM, Matthew McCline wrote:
>
> ​
>
> What version of Hive are you on?
>
>
> --
> *From:* Mahender Sarangam 
> 
> *Sent:* Saturday, May 14, 2016 3:29 PM
> *To:* user@hive.apache.org
> *Subject:* Query Failing while querying on ORC Format
>
> Hi,
> We are dumping our data into ORC Partition Bucketed table. We have loaded
> almost 6 months data and here month is Partition by column. Now we have
> modified ORC partition bucketed table schema. We have added 2 more columns
> to the ORC table. Now whenever we are running select statement for older
> month which has no columns( even though these columns are not part in
> select clause, (projection column) ), it is throwing exception.
>
> There is JIRA bug for this kind of requirement has already been raised.
> https://issues.apache.org/jira/browse/HIVE-11981
>
> Can any one please tell me know alternative workaround for reading old
> previous columns of ORC partition table.
>
> Thanks
>
>
>

RE: Would like to be a user

[Markovitz, Dudu]

Hi Lefty

Can you add me as well?
My user is dudu.markovitz

Thanks

Dudu

From: Lefty Leverenz [mailto:leftylever...@gmail.com]
Sent: Monday, May 16, 2016 11:44 PM
To: user@hive.apache.org
Subject: Re: Would like to be a user

Welcome Gail, I've given you write access to the Hive wiki.  Thanks in advance 
for your contributions!

-- Lefty

On Mon, May 16, 2016 at 4:39 PM, gail haspert 
> wrote:
Hi
I would like to start working on (write to) apache hive. My confluence user 
name is ghaspert.

thanks
-- Forwarded message --
From: gail haspert >
Date: Mon, May 16, 2016 at 12:40 PM
Subject: Would like to be a user
To: user-subscr...@hive.apache.org

I just signed up as ghaspert for a confluence account.
Thanks,
Gail