[jira] [Created] (HIVE-26921) Add failover_type, failover_endpoint to replication metrics metadata

2023-01-09 Thread Amit Saonerkar (Jira)
Amit Saonerkar created HIVE-26921:
-

 Summary: Add failover_type, failover_endpoint to replication 
metrics metadata
 Key: HIVE-26921
 URL: https://issues.apache.org/jira/browse/HIVE-26921
 Project: Hive
  Issue Type: Improvement
  Components: HiveServer2
Reporter: Amit Saonerkar
Assignee: Amit Saonerkar


Corresponding to CDPD-46494



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (HIVE-26920) Add-new-view-in-sys-db-to-capture-failover-and-failback-metrics

2023-01-09 Thread Amit Saonerkar (Jira)
Amit Saonerkar created HIVE-26920:
-

 Summary: 
Add-new-view-in-sys-db-to-capture-failover-and-failback-metrics
 Key: HIVE-26920
 URL: https://issues.apache.org/jira/browse/HIVE-26920
 Project: Hive
  Issue Type: New Feature
  Components: HiveServer2
Reporter: Amit Saonerkar
Assignee: Amit Saonerkar


Corresponding to CDPD-46702



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (HIVE-26919) Fix-test-case-TestReplicationOptimisedBootstrap.testReverseFailoverBeforeOptimizedBootstrap

2023-01-09 Thread Amit Saonerkar (Jira)
Amit Saonerkar created HIVE-26919:
-

 Summary: 
Fix-test-case-TestReplicationOptimisedBootstrap.testReverseFailoverBeforeOptimizedBootstrap
 Key: HIVE-26919
 URL: https://issues.apache.org/jira/browse/HIVE-26919
 Project: Hive
  Issue Type: Bug
  Components: HiveServer2
Reporter: Amit Saonerkar
Assignee: Amit Saonerkar


This Jira is related to test case failure corresponding to Jira CDPD-48053



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (HIVE-26918) Upgrade jamon-runtime to 2.4.1

2023-01-09 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created HIVE-26918:


 Summary: Upgrade jamon-runtime to 2.4.1
 Key: HIVE-26918
 URL: https://issues.apache.org/jira/browse/HIVE-26918
 Project: Hive
  Issue Type: Bug
  Components: Web UI
Reporter: Dongjoon Hyun






--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (HIVE-26917) Upgrade parquet to 1.12.3

2023-01-09 Thread Rajesh Balamohan (Jira)
Rajesh Balamohan created HIVE-26917:
---

 Summary: Upgrade parquet to 1.12.3
 Key: HIVE-26917
 URL: https://issues.apache.org/jira/browse/HIVE-26917
 Project: Hive
  Issue Type: Improvement
Reporter: Rajesh Balamohan






--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (HIVE-26916) Disable TestJdbcGenericUDTFGetSplits (Done as part of HIVE-22942)

2023-01-09 Thread Aman Raj (Jira)
Aman Raj created HIVE-26916:
---

 Summary: Disable TestJdbcGenericUDTFGetSplits (Done as part of 
HIVE-22942)
 Key: HIVE-26916
 URL: https://issues.apache.org/jira/browse/HIVE-26916
 Project: Hive
  Issue Type: Sub-task
Reporter: Aman Raj
Assignee: Aman Raj






--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (HIVE-26915) Backport of HIVE-23692 TestCodahaleMetrics.testFileReporting is flaky

2023-01-09 Thread Aman Raj (Jira)
Aman Raj created HIVE-26915:
---

 Summary: Backport of HIVE-23692 
TestCodahaleMetrics.testFileReporting is flaky
 Key: HIVE-26915
 URL: https://issues.apache.org/jira/browse/HIVE-26915
 Project: Hive
  Issue Type: Sub-task
Reporter: Aman Raj
Assignee: Aman Raj






--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (HIVE-26914) Upgrade postgresql to 42.5.1 due to CVE-2022-41946

2023-01-09 Thread Devaspati Krishnatri (Jira)
Devaspati Krishnatri created HIVE-26914:
---

 Summary: Upgrade postgresql to 42.5.1 due to CVE-2022-41946
 Key: HIVE-26914
 URL: https://issues.apache.org/jira/browse/HIVE-26914
 Project: Hive
  Issue Type: Task
Reporter: Devaspati Krishnatri






--
This message was sent by Atlassian Jira
(v8.20.10#820010)


Re: Proposal: Revamp Apache Hive website.

2023-01-09 Thread Stamatis Zampetakis
Hi everyone,

Simhadri has been working hard to modernize the Hive website (HIVE-26565)
for the past few months and I am quite happy with the results.

I reviewed the respective PR [1] and will commit the changes in 24h unless
there are objections.

Best,
Stamatis

[1] https://github.com/apache/hive-site/pull/2

On Wed, Oct 5, 2022 at 8:46 PM Simhadri G  wrote:

> Thanks for the feedback Stamatis !
>
>- I have updated the PR to include a README.md file with instructions
>to build and view the site locally after making any new changes. This will
>help us preview the changes locally before pushing the commit. (Docker is
>not required here.)
>
>- Github pages was used to share the new website with the community
>and it will most likely not be necessary later on.
>
>- Regarding the role of Github Actions(gh-pages.yml):
>
>- Whenever a PR is merged to the main branch, a github action is
>   triggered .
>   - Github action will install a hugo and build the site with the new
>   changes.  Once the build is successful, HUGO then generates a set of 
> static
>   files and these files are automatically merged to the hive-site/asf-site
>   branch by github actions bot.
>   - From here, to publish  hive-site/asf-site to project web site
>   sub-domain (hive.apache.org),  we need to set up a configuration
>   block called publish in your .asf.yaml file. (
>   
> https://cwiki.apache.org/confluence/display/INFRA/Git+-+.asf.yaml+features#Git.asf.yamlfeatures-Publishingabranchtoyourprojectwebsite).
>
>   - We will need help from apache infra - gmcdonald
>    or
>   Humbedooh
>    to
>   make sure that we have set this up correctly.
>
>   - I agree with your suggestion to keep the changes around the
>revamp as minimal as possible and not mix the content update with the
>framework change. In this case, we can make the other changes incrementally
>at a later stage.
>
>
> Thanks!
> Simhadri G
>
> On Wed, Oct 5, 2022 at 3:41 PM Stamatis Zampetakis 
> wrote:
>
>> Thanks for staying on top of this Simhadri.
>>
>> I will try to help reviewing the PR once I get some time.
>>
>> What is not yet clear to me from this discussion or by looking at the PR
>> is the workflow for making a change appear on the web (
>> https://hive.apache.org/). Having a README which clearly states what
>> needs to be done is a must.
>>
>> I also think it is quite important to have instructions and possibly
>> docker images for someone to be able to test how the changes look locally
>> before commiting a change to the repo.
>>
>> Another point that needs clarification is the role of github pages. I am
>> not sure why it is necessary at the moment and what exactly is the plan
>> going forward. If I understand well, currently it is used to preview the
>> changes but from my perspective we shouldn't need to commit something to
>> the repo to understand if something breaks or not; preview should happen
>> locally.
>>
>> I would suggest to keep the changes around the revamp as minimal as
>> possible and not mix the content update with the framework change. As
>> usual, smaller changes are easier to review and merge. It is definitely
>> worth updating and improving the content but let's do it incrementally so
>> that changes can get merged faster.
>>
>> The list of committers and PMC members for Hive can be found in the
>> apache phonebook [1]. The list can easily get outdated so maybe we can
>> consider adding links to [1] and/or github and other places instead of
>> duplicating the content. Anyways, let's first deal with the revamp and
>> discuss content changes later in separate JIRAs/PRs.
>>
>> Best,
>> Stamatis
>>
>> [1] https://home.apache.org/phonebook.html?project=hive
>>
>> On Sun, Oct 2, 2022 at 2:41 AM Simhadri G  wrote:
>>
>>> Hello Everyone,
>>>
>>> I have raised the PR for the revamped Hive Website here:
>>>  https://github.com/apache/hive-site/pull/2
>>>
>>> I kindly request if someone can help review this PR .
>>>
>>> Until the PR is merged, you can find the updated website here . Please
>>> have a look and any feedback is most welcome :)
>>> https://simhadri-g.github.io/hive-site/
>>>
>>> Few other things to note:
>>>
>>>- We will need help from someone who has write access to hive-site
>>>repo to update the github workflow once PR is merged.
>>>- One more important question, I came across this (
>>>https://hive.apache.org/people.html ) page, while moving the .md
>>>file to the new website, which lists the current pmc and committers of
>>>hive. I noticed that this list is not upto date, a lot of people seem to 
>>> be
>>>missing from this list. May I please know where I can find the updated 
>>> date
>>>list of committers and PMCs which I can refer to and update the page.
>>>- Lastly, 

[jira] [Created] (HIVE-26913) HiveVectorizedReader::parquetRecordReader should reuse footer information

2023-01-09 Thread Rajesh Balamohan (Jira)
Rajesh Balamohan created HIVE-26913:
---

 Summary: HiveVectorizedReader::parquetRecordReader should reuse 
footer information
 Key: HIVE-26913
 URL: https://issues.apache.org/jira/browse/HIVE-26913
 Project: Hive
  Issue Type: Improvement
  Components: Iceberg integration
Reporter: Rajesh Balamohan


HiveVectorizedReader::parquetRecordReader should reuse details of parquet 
footer, instead of reading it again.

 

It reads parquet footer here:

[https://github.com/apache/hive/blob/master/iceberg/iceberg-handler/src/main/java/org/apache/iceberg/mr/hive/vector/HiveVectorizedReader.java#L230-L232]

Again it reads the footer here for constructing vectorized recordreader

[https://github.com/apache/hive/blob/master/iceberg/iceberg-handler/src/main/java/org/apache/iceberg/mr/hive/vector/HiveVectorizedReader.java#L249]

 

[https://github.com/apache/hive/blob/master/ql/src/java/org/apache/hadoop/hive/ql/io/parquet/VectorizedParquetInputFormat.java#L50]

 

Check the codepath of 
VectorizedParquetRecordReader::setupMetadataAndParquetSplit

[https://github.com/apache/hive/blob/6b0139188aba6a95808c8d1bec63a651ec9e4bdc/ql/src/java/org/apache/hadoop/hive/ql/io/parquet/vector/VectorizedParquetRecordReader.java#L180]

 

It should be possible to share "ParquetMetadata" in 
VectorizedParuqetRecordReader.

 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (HIVE-26912) Publish SBOM artifacts

2023-01-09 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created HIVE-26912:


 Summary: Publish SBOM artifacts
 Key: HIVE-26912
 URL: https://issues.apache.org/jira/browse/HIVE-26912
 Project: Hive
  Issue Type: Improvement
  Components: Build Infrastructure
Affects Versions: 4.0.0
Reporter: Dongjoon Hyun






--
This message was sent by Atlassian Jira
(v8.20.10#820010)