[jira] [Created] (HIVE-26539) Prevent unsafe deserialization in PartitionExpressionForMetastore

[Zhihua Deng (Jira)]

Zhihua Deng created HIVE-26539:
--

 Summary: Prevent unsafe deserialization in 
PartitionExpressionForMetastore
 Key: HIVE-26539
 URL: https://issues.apache.org/jira/browse/HIVE-26539
 Project: Hive
  Issue Type: Improvement
Reporter: Zhihua Deng






--
This message was sent by Atlassian Jira
(v8.20.10#820010)

[jira] [Created] (HIVE-26538) MetastoreDefaultTransformer should revise the location when it's empty

[Zhihua Deng (Jira)]

Zhihua Deng created HIVE-26538:
--

 Summary: MetastoreDefaultTransformer should revise the location 
when it's empty
 Key: HIVE-26538
 URL: https://issues.apache.org/jira/browse/HIVE-26538
 Project: Hive
  Issue Type: Improvement
  Components: Standalone Metastore
Reporter: Zhihua Deng


The table's location is treated as null when it's empty, this takes place 
somewhere such as:

[https://github.com/apache/hive/blob/82f319773cb2361a98963e861fb903ab8eecd9c4/standalone-metastore/metastore-server/src/main/java/org/apache/hadoop/hive/metastore/HMSHandler.java#L2367]

[https://github.com/apache/hive/blob/master/standalone-metastore/metastore-server/src/main/java/org/apache/hadoop/hive/metastore/MetastoreDefaultTransformer.java#L729]
  

MetastoreDefaultTransformer should revise the empty location when 
altering/creating tables.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

[jira] [Created] (HIVE-26537) Deprecate older APIs in the HMS

[Sai Hemanth Gantasala (Jira)]

Sai Hemanth Gantasala created HIVE-26537:


 Summary: Deprecate older APIs in the HMS
 Key: HIVE-26537
 URL: https://issues.apache.org/jira/browse/HIVE-26537
 Project: Hive
  Issue Type: Improvement
Affects Versions: 4.0.0-alpha-1, 4.0.0-alpha-2
Reporter: Sai Hemanth Gantasala
Assignee: Sai Hemanth Gantasala


This Jira is to track the clean-up(deprecate older APIs and point the HMS 
client to the newer APIs) work in the hive metastore server.

More details will be added here soon.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Re: Proposal: Revamp Apache Hive website.

[Stamatis Zampetakis]

Hi all,

It's great to see some effort in improving the website. The POC from
Simhadri looks really cool; I didn't check the content but I love the look
and feel.

Now regarding the current process for modifying and updating the website
there is some info in this relatively recent thread [1].

Moving forward, I would really like to have the source code of the website
(markdown etc) in the main repo of the project [2], and use GitHub actions
to automatically build and push the content to the site repo [3] per commit
basis.
This workflow is used in Apache Calcite and I find it extremely convenient.

Best,
Stamatis

[1] https://lists.apache.org/thread/4b6x4d6z4tgnv4mo0ycg30y4dlt0msbd
[2] https://github.com/apache/hive
[3] https://github.com/apache/hive-site

On Thu, Sep 15, 2022 at 10:50 PM Ayush Saxena  wrote:

> Owen,
> I am not sure if I am catching you right, But now the repository for the
> website has changed, we no longer use our main *hive.git* repository for
> the website, We are using the* hive-site *repository for the website, The
> migration happened this year January I suppose.
>
> Can give a check to the set of commit here from: gmcdonald
>  and
> Humbedooh 
> https://github.com/apache/hive-site/commits/main
>
> Now whatever you push to main branch of hive-site(
> https://github.com/apache/hive-site) it gets published on the *asf-site*
> branch by the buildbot(
> https://github.com/apache/hive-site/commits/asf-site)
>
> Simhadri's changes will be directed to the main branch of the hive-site
> repo and they will get auto published on the asf-site branch, I tried this
> a couple of months back and it indeed worked that way. Let me know if we
> are missing anything on this, I tried to find threads around this but not
> sure if it is in private@ or so, couldn't find, I will try again and if
> there is something around that what needs to be done, I will have a word
> with the Infra folks and get that sorted, if it isn't already.
>
> -Ayush
>
> On Fri, 16 Sept 2022 at 01:49, Owen O'Malley 
> wrote:
>
>> Look at the threads and talk to Apache Infra. They couldn't make it work
>> before. We would have needed to manually publish to the asf-site branch.
>>
>> On Thu, Sep 15, 2022 at 7:54 PM Simhadri G  wrote:
>>
>>> Thanks Ayush, Pau Tallada and Owen O'Malley for the feedback!
>>>
>>> @Owen , This website revamp indeed replaces the website with markdown as
>>> you have mentioned. I have referred to your PR for some of the content for
>>> the site.
>>> The actual code for the website is here:
>>> https://github.com/simhadri-g/hive-site/tree/new-site
>>>
>>> Once we add markdown files to the source code under /content/ , hugo
>>> will rebuild the files and generate the static html files in ./public/
>>> directory.
>>> I have copied over these static files to a separate repo and temporarily
>>> hosted it with gh-pages to start the mail chain.
>>>
>>>  For the final site, I am already trying to automate this with github
>>> actions. So, as soon as any new changes are made to the site branch, the
>>> github actions will automatically tigger and update the site.
>>>
>>> Thanks!
>>>
>>> On Fri, Sep 16, 2022 at 12:17 AM Owen O'Malley 
>>> wrote:
>>>
 I found it - https://github.com/apache/hive/pull/1410

 On Thu, Sep 15, 2022 at 6:42 PM Owen O'Malley 
 wrote:

> I had a PR to replace the website with markdown. Apache Infra was
> supposed to make it autopublish. *sigh*
>
> .. Owen
>
> On Thu, Sep 15, 2022 at 4:23 PM Pau Tallada  wrote:
>
>> Hi,
>>
>> Great work!
>> +1 on updating it as well
>>
>> Missatge de Ayush Saxena  del dia dj., 15 de
>> set. 2022 a les 17:40:
>>
>>> Hi Simhadri,
>>> Thanx for the initiative, +1 on updating our current website.
>>> The new website looks way better than the existing one.
>>> Can create a Jira and link this to that after a couple of days if
>>> there aren’t any objections to the move, so as people can drop further
>>> suggestions over there.
>>>
>>> -Ayush
>>>
>>> > On 15-Sep-2022, at 8:33 PM, SG  wrote:
>>> >
>>> > Hi Everyone,
>>> >
>>> > The existing apache hive website https://hive.apache.org/ hasn't
>>> been
>>> > updated for a very long time. Additionally, I was not able to
>>> build the
>>> > docker image associated with the site to test out new changes as
>>> well.
>>> > https://github.com/apache/hive-site
>>> >
>>> > Since the website is the front page of the project, I believe it
>>> would be
>>> > good to revamp the apache hive website with the latest features and
>>> > releases.
>>> >
>>> > As a result, I have spent some time setting up an initial draft of
>>> the
>>> > website. There are still quite a few things that still need to be
>>> > 

Re: Proposal: Revamp Apache Hive website.

[Ayush Saxena]

Owen,
I am not sure if I am catching you right, But now the repository for the
website has changed, we no longer use our main *hive.git* repository for
the website, We are using the* hive-site *repository for the website, The
migration happened this year January I suppose.

Can give a check to the set of commit here from: gmcdonald
 and Humbedooh

https://github.com/apache/hive-site/commits/main

Now whatever you push to main branch of hive-site(
https://github.com/apache/hive-site) it gets published on the *asf-site*
branch by the buildbot(https://github.com/apache/hive-site/commits/asf-site)

Simhadri's changes will be directed to the main branch of the hive-site
repo and they will get auto published on the asf-site branch, I tried this
a couple of months back and it indeed worked that way. Let me know if we
are missing anything on this, I tried to find threads around this but not
sure if it is in private@ or so, couldn't find, I will try again and if
there is something around that what needs to be done, I will have a word
with the Infra folks and get that sorted, if it isn't already.

-Ayush

On Fri, 16 Sept 2022 at 01:49, Owen O'Malley  wrote:

> Look at the threads and talk to Apache Infra. They couldn't make it work
> before. We would have needed to manually publish to the asf-site branch.
>
> On Thu, Sep 15, 2022 at 7:54 PM Simhadri G  wrote:
>
>> Thanks Ayush, Pau Tallada and Owen O'Malley for the feedback!
>>
>> @Owen , This website revamp indeed replaces the website with markdown as
>> you have mentioned. I have referred to your PR for some of the content for
>> the site.
>> The actual code for the website is here:
>> https://github.com/simhadri-g/hive-site/tree/new-site
>>
>> Once we add markdown files to the source code under /content/ , hugo will
>> rebuild the files and generate the static html files in ./public/
>> directory.
>> I have copied over these static files to a separate repo and temporarily
>> hosted it with gh-pages to start the mail chain.
>>
>>  For the final site, I am already trying to automate this with github
>> actions. So, as soon as any new changes are made to the site branch, the
>> github actions will automatically tigger and update the site.
>>
>> Thanks!
>>
>> On Fri, Sep 16, 2022 at 12:17 AM Owen O'Malley 
>> wrote:
>>
>>> I found it - https://github.com/apache/hive/pull/1410
>>>
>>> On Thu, Sep 15, 2022 at 6:42 PM Owen O'Malley 
>>> wrote:
>>>
 I had a PR to replace the website with markdown. Apache Infra was
 supposed to make it autopublish. *sigh*

 .. Owen

 On Thu, Sep 15, 2022 at 4:23 PM Pau Tallada  wrote:

> Hi,
>
> Great work!
> +1 on updating it as well
>
> Missatge de Ayush Saxena  del dia dj., 15 de set.
> 2022 a les 17:40:
>
>> Hi Simhadri,
>> Thanx for the initiative, +1 on updating our current website.
>> The new website looks way better than the existing one.
>> Can create a Jira and link this to that after a couple of days if
>> there aren’t any objections to the move, so as people can drop further
>> suggestions over there.
>>
>> -Ayush
>>
>> > On 15-Sep-2022, at 8:33 PM, SG  wrote:
>> >
>> > Hi Everyone,
>> >
>> > The existing apache hive website https://hive.apache.org/ hasn't
>> been
>> > updated for a very long time. Additionally, I was not able to build
>> the
>> > docker image associated with the site to test out new changes as
>> well.
>> > https://github.com/apache/hive-site
>> >
>> > Since the website is the front page of the project, I believe it
>> would be
>> > good to revamp the apache hive website with the latest features and
>> > releases.
>> >
>> > As a result, I have spent some time setting up an initial draft of
>> the
>> > website. There are still quite a few things that still need to be
>> > added/updated in the draft.  Here is the prototype site that I put
>> together
>> > so everyone could check it out:
>> https://simhadri-g.github.io/hive-site-hugo/
>> >
>> > The new website is based on Hugo. Hugo, is one of the most popular
>> > open-source static site generators. I was able to get a hugo
>> version of the
>> > site up very quickly with a landing page and docs and hugo also
>> makes
>> > maintaining the site very simple.
>> >
>> > Please have a look. Any feedback is much appreciated.
>> >
>> > Existing website: https://hive.apache.org/
>> > New website: https://simhadri-g.github.io/hive-site-hugo/
>> >
>> > Thanks!
>> > Simhadri G
>>
>
>
> --
> --
> Pau Tallada Crespí
> Departament de Serveis
> Port d'Informació Científica (PIC)
> Tel: +34 93 170 2729
> 

Re: Proposal: Revamp Apache Hive website.

[Owen O'Malley]

I had a PR to replace the website with markdown. Apache Infra was supposed
to make it autopublish. *sigh*

.. Owen

On Thu, Sep 15, 2022 at 4:23 PM Pau Tallada  wrote:

> Hi,
>
> Great work!
> +1 on updating it as well
>
> Missatge de Ayush Saxena  del dia dj., 15 de set.
> 2022 a les 17:40:
>
>> Hi Simhadri,
>> Thanx for the initiative, +1 on updating our current website.
>> The new website looks way better than the existing one.
>> Can create a Jira and link this to that after a couple of days if there
>> aren’t any objections to the move, so as people can drop further
>> suggestions over there.
>>
>> -Ayush
>>
>> > On 15-Sep-2022, at 8:33 PM, SG  wrote:
>> >
>> > Hi Everyone,
>> >
>> > The existing apache hive website https://hive.apache.org/ hasn't been
>> > updated for a very long time. Additionally, I was not able to build the
>> > docker image associated with the site to test out new changes as well.
>> > https://github.com/apache/hive-site
>> >
>> > Since the website is the front page of the project, I believe it would
>> be
>> > good to revamp the apache hive website with the latest features and
>> > releases.
>> >
>> > As a result, I have spent some time setting up an initial draft of the
>> > website. There are still quite a few things that still need to be
>> > added/updated in the draft.  Here is the prototype site that I put
>> together
>> > so everyone could check it out:
>> https://simhadri-g.github.io/hive-site-hugo/
>> >
>> > The new website is based on Hugo. Hugo, is one of the most popular
>> > open-source static site generators. I was able to get a hugo version of
>> the
>> > site up very quickly with a landing page and docs and hugo also makes
>> > maintaining the site very simple.
>> >
>> > Please have a look. Any feedback is much appreciated.
>> >
>> > Existing website: https://hive.apache.org/
>> > New website: https://simhadri-g.github.io/hive-site-hugo/
>> >
>> > Thanks!
>> > Simhadri G
>>
>
>
> --
> --
> Pau Tallada Crespí
> Departament de Serveis
> Port d'Informació Científica (PIC)
> Tel: +34 93 170 2729
> --
>
>

[jira] [Created] (HIVE-26536) Enable 'hive.acid.truncate.usebase' by default

[Sourabh Badhya (Jira)]

Sourabh Badhya created HIVE-26536:
-

 Summary: Enable 'hive.acid.truncate.usebase' by default
 Key: HIVE-26536
 URL: https://issues.apache.org/jira/browse/HIVE-26536
 Project: Hive
  Issue Type: Improvement
Reporter: Sourabh Badhya
Assignee: Sourabh Badhya


The config 'hive.metastore.acid.truncate.usebase' was disabled due to 
HIVE-25050 and subsequent patches in master have renamed it to 
'hive.acid.truncate.usebase'. However, since the necessary fixes required for 
this config are already present in the current master branch, we can enable it 
by default. Hence the scope of this Jira will be to enable this in the master 
branch only so that eventual releases can benefit from this feature. 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Re: Proposal: Revamp Apache Hive website.

[Ayush Saxena]

Hi Simhadri,
Thanx for the initiative, +1 on updating our current website.
The new website looks way better than the existing one.
Can create a Jira and link this to that after a couple of days if there aren’t 
any objections to the move, so as people can drop further suggestions over 
there.

-Ayush

> On 15-Sep-2022, at 8:33 PM, SG  wrote:
> 
> Hi Everyone,
> 
> The existing apache hive website https://hive.apache.org/ hasn't been
> updated for a very long time. Additionally, I was not able to build the
> docker image associated with the site to test out new changes as well.
> https://github.com/apache/hive-site
> 
> Since the website is the front page of the project, I believe it would be
> good to revamp the apache hive website with the latest features and
> releases.
> 
> As a result, I have spent some time setting up an initial draft of the
> website. There are still quite a few things that still need to be
> added/updated in the draft.  Here is the prototype site that I put together
> so everyone could check it out: https://simhadri-g.github.io/hive-site-hugo/
> 
> The new website is based on Hugo. Hugo, is one of the most popular
> open-source static site generators. I was able to get a hugo version of the
> site up very quickly with a landing page and docs and hugo also makes
> maintaining the site very simple.
> 
> Please have a look. Any feedback is much appreciated.
> 
> Existing website: https://hive.apache.org/
> New website: https://simhadri-g.github.io/hive-site-hugo/
> 
> Thanks!
> Simhadri G

Proposal: Revamp Apache Hive website.

[SG]

Hi Everyone,

The existing apache hive website https://hive.apache.org/ hasn't been
updated for a very long time. Additionally, I was not able to build the
docker image associated with the site to test out new changes as well.
https://github.com/apache/hive-site

Since the website is the front page of the project, I believe it would be
good to revamp the apache hive website with the latest features and
releases.

As a result, I have spent some time setting up an initial draft of the
website. There are still quite a few things that still need to be
added/updated in the draft.  Here is the prototype site that I put together
so everyone could check it out: https://simhadri-g.github.io/hive-site-hugo/

The new website is based on Hugo. Hugo, is one of the most popular
open-source static site generators. I was able to get a hugo version of the
site up very quickly with a landing page and docs and hugo also makes
maintaining the site very simple.

Please have a look. Any feedback is much appreciated.

Existing website: https://hive.apache.org/
New website: https://simhadri-g.github.io/hive-site-hugo/

Thanks!
Simhadri G