[jira] [Created] (HIVE-26946) Hive beeline connect failed, hiveserver2log:lockmgr.DbTxnManager: Sending heartbeat for txnid:0 and

2023-01-16 Thread longlhl (Jira)
longlhl created HIVE-26946:
--

 Summary: Hive beeline connect failed, 
hiveserver2log:lockmgr.DbTxnManager: Sending heartbeat for txnid:0 and
 Key: HIVE-26946
 URL: https://issues.apache.org/jira/browse/HIVE-26946
 Project: Hive
  Issue Type: Bug
  Components: Beeline
Affects Versions: 2.1.1
 Environment: Hive-v2.1.1
Reporter: longlhl


Hive beeline connect failed.

hiveserver2log

2022-12-29T00:00:56,762  INFO [Heartbeater-3] lockmgr.DbTxnManager: Sending 
heartbeat for txnid:0 and
2022-12-29T00:03:26,762  INFO [Heartbeater-3] lockmgr.DbTxnManager: Sending 
heartbeat for txnid:0 and
2022-12-29T00:05:56,762  INFO [Heartbeater-3] lockmgr.DbTxnManager: Sending 
heartbeat for txnid:0 and



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (HIVE-26947) Hive compactor.Worker can respawn connections to HMS at extremely high frequency

2023-01-16 Thread Akshat Mathur (Jira)
Akshat Mathur created HIVE-26947:


 Summary: Hive compactor.Worker can respawn connections to HMS at 
extremely high frequency
 Key: HIVE-26947
 URL: https://issues.apache.org/jira/browse/HIVE-26947
 Project: Hive
  Issue Type: Improvement
Reporter: Akshat Mathur


After catching the exception generated by the findNextCompactionAndExecute() 
task, HS2 appears to immediately rerun the task with no delay or backoff.  As a 
result there are ~3500 connection attempts from HS2 to HMS over just a 5 second 
period in the HS2 log

The compactor.Worker should wait between failed attempts and maybe do an 
exponential backoff.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


Re: [ANNOUNCE] New PMC Member: Stamatis Zampetakis

2023-01-16 Thread Jiajun Xie
Congratulations Stamatis :)
Very well deserved!!!

On Mon, 16 Jan 2023 at 13:51, Krisztian Kasa 
wrote:

> Congratulations Stamatis :)
>
> On Mon, Jan 16, 2023 at 6:27 AM S T  wrote:
>
> > Congrats Stamatis.
> >
> > Thanks
> >
> > On Sat, 14 Jan 2023 at 00:03, Naveen Gangam 
> wrote:
> >
> >> Hello Hive Community,
> >> Apache Hive PMC is pleased to announce that Stamatis Zampetakis has
> >> accepted the Apache Hive PMC's invitation to become PMC Member, and is
> now
> >> our newest PMC member. Please join me in congratulating Stamatis !!!
> >>
> >> He has been an active member in the hive community across many aspects
> of
> >> the project. Many thanks to Stamatis for all the contributions he has
> made
> >> and looking forward to many more future contributions in the expanded
> role.
> >>
> >> Cheers,
> >> Naveen (on behalf of Hive PMC)
> >>
> >
>


Re: [ANNOUNCE] New PMC Member: Stamatis Zampetakis

2023-01-16 Thread Stamatis Zampetakis
Thanks everyone! I am very glad and honoured to join the PMC.

I really enjoy being part of this community and It is great interacting
with all of you on a daily basis; thank you for being part of this!

Best,
Stamatis

On Mon, Jan 16, 2023 at 2:12 PM Jiajun Xie 
wrote:

> Congratulations Stamatis :)
> Very well deserved!!!
>
> On Mon, 16 Jan 2023 at 13:51, Krisztian Kasa 
> wrote:
>
> > Congratulations Stamatis :)
> >
> > On Mon, Jan 16, 2023 at 6:27 AM S T  wrote:
> >
> > > Congrats Stamatis.
> > >
> > > Thanks
> > >
> > > On Sat, 14 Jan 2023 at 00:03, Naveen Gangam 
> > wrote:
> > >
> > >> Hello Hive Community,
> > >> Apache Hive PMC is pleased to announce that Stamatis Zampetakis has
> > >> accepted the Apache Hive PMC's invitation to become PMC Member, and is
> > now
> > >> our newest PMC member. Please join me in congratulating Stamatis !!!
> > >>
> > >> He has been an active member in the hive community across many aspects
> > of
> > >> the project. Many thanks to Stamatis for all the contributions he has
> > made
> > >> and looking forward to many more future contributions in the expanded
> > role.
> > >>
> > >> Cheers,
> > >> Naveen (on behalf of Hive PMC)
> > >>
> > >
> >
>


[jira] [Created] (HIVE-26948) Backport HIVE-21456 to branch-3

2023-01-16 Thread Vihang Karajgaonkar (Jira)
Vihang Karajgaonkar created HIVE-26948:
--

 Summary: Backport HIVE-21456 to branch-3
 Key: HIVE-26948
 URL: https://issues.apache.org/jira/browse/HIVE-26948
 Project: Hive
  Issue Type: Improvement
  Components: Metastore, Standalone Metastore
Reporter: Vihang Karajgaonkar
Assignee: Vihang Karajgaonkar


HIVE-21456 adds support to connect to Hive metastore over http transport. This 
is a very useful feature especially in cloud based environments. Creating this 
ticket to backport it to branch-3.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (HIVE-26949) Backport HIVE-26071 to branch-3

2023-01-16 Thread Vihang Karajgaonkar (Jira)
Vihang Karajgaonkar created HIVE-26949:
--

 Summary: Backport HIVE-26071 to branch-3
 Key: HIVE-26949
 URL: https://issues.apache.org/jira/browse/HIVE-26949
 Project: Hive
  Issue Type: Improvement
Reporter: Vihang Karajgaonkar
Assignee: Vihang Karajgaonkar


Creating this ticket to backport HIVE-26071 to branch-3.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (HIVE-26950) (CTLT) Create external table like V2 table is not preserving table properties

2023-01-16 Thread Rajesh Balamohan (Jira)
Rajesh Balamohan created HIVE-26950:
---

 Summary: (CTLT) Create external table like V2 table is not 
preserving table properties
 Key: HIVE-26950
 URL: https://issues.apache.org/jira/browse/HIVE-26950
 Project: Hive
  Issue Type: Improvement
  Components: Iceberg integration
Reporter: Rajesh Balamohan


# Create an external iceberg V2 table. e.g t1
 # "create external table t2 like t1" <--- This ends up creating V1 table and 
"format-version=2" is not retained and "'format'='iceberg/parquet'" is also not 
retained.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (HIVE-26951) Setting details in PositionDeleteInfo takes up lot of CPU cycles

2023-01-16 Thread Rajesh Balamohan (Jira)
Rajesh Balamohan created HIVE-26951:
---

 Summary: Setting details in PositionDeleteInfo takes up lot of CPU 
cycles
 Key: HIVE-26951
 URL: https://issues.apache.org/jira/browse/HIVE-26951
 Project: Hive
  Issue Type: Improvement
  Components: Iceberg integration
Reporter: Rajesh Balamohan
 Attachments: Screenshot 2023-01-17 at 11.29.29 AM.png, Screenshot 
2023-01-17 at 11.29.36 AM.png

!Screenshot 2023-01-17 at 11.29.29 AM.png|width=898,height=532!

 

 

!Screenshot 2023-01-17 at 11.29.36 AM.png|width=1000,height=591!

 

This was observed with merge-into statements.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (HIVE-26952) set the value of metastore.storage.schema.reader.impl
 to org.apache.hadoop.hive.metastore.SerDeStorageSchemaReader as default

2023-01-16 Thread Taraka Rama Rao Lethavadla (Jira)
Taraka Rama Rao Lethavadla created HIVE-26952:
-

 Summary: set the value of metastore.storage.schema.reader.impl
 to 
org.apache.hadoop.hive.metastore.SerDeStorageSchemaReader as default
 Key: HIVE-26952
 URL: https://issues.apache.org/jira/browse/HIVE-26952
 Project: Hive
  Issue Type: Improvement
  Components: Standalone Metastore
Reporter: Taraka Rama Rao Lethavadla
Assignee: Taraka Rama Rao Lethavadla


With the default value of

 
{code:java}
DefaultStorageSchemaReader.class.getName(){code}
 

in the Metastore Config, *metastore.storage.schema.reader.impl*

below exception is thrown when trying to read Avro schema
{noformat}
Caused by: org.apache.hive.service.cli.HiveSQLException: MetaException 
(message:java.lang.UnsupportedOperationException: Storage schema reading not 
supported)
    at 
org.apache.hive.service.cli.operation.GetColumnsOperation.runInternal(GetColumnsOperation.java:213)
    at org.apache.hive.service.cli.operation.Operation.run(Operation.java:247)
    at 
org.apache.hive.service.cli.session.HiveSessionImpl.getColumns(HiveSessionImpl.java:729)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
    at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke(Method.java:498)
    at 
org.apache.hive.service.cli.session.HiveSessionProxy.invoke(HiveSessionProxy.java:78)
    at 
org.apache.hive.service.cli.session.HiveSessionProxy.access-zsh(HiveSessionProxy.java:36)
    at 
org.apache.hive.service.cli.session.HiveSessionProxy.run(HiveSessionProxy.java:63)
    at java.security.AccessController.doPrivileged(Native Method)
    at javax.security.auth.Subject.doAs(Subject.java:422)
    at 
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1730)
    at 
org.apache.hive.service.cli.session.HiveSessionProxy.invoke(HiveSessionProxy.java:59)
    at com.sun.proxy..getColumns(Unknown Source)
    at 
org.apache.hive.service.cli.CLIService.getColumns(CLIService.java:390){noformat}
setting the above config with 
*org.apache.hadoop.hive.metastore.SerDeStorageSchemaReader* resolves issue

Proposing to make this value as default in code base, so that in upcoming 
versions we don't have to set this value manually



--
This message was sent by Atlassian Jira
(v8.20.10#820010)