[jira] [Created] (HIVE-25730) Hive column update performance too low when table partition over 700

2021-11-21 Thread JungHyun An (Jira)
JungHyun An created HIVE-25730:
--

 Summary: Hive column update performance too low when table 
partition over 700
 Key: HIVE-25730
 URL: https://issues.apache.org/jira/browse/HIVE-25730
 Project: Hive
  Issue Type: Bug
  Components: Metastore
Affects Versions: 3.1.1
Reporter: JungHyun An
 Fix For: 3.1.1


Hi, we using hive 3.1.1

Currently in our hive have tables with hundreds of partitions and hundreds of 
gigabytes of data.

When updating the column information of the corresponding table, it was 
confirmed that the performance was several tens of times slower than the Hive 
1.1 version of the older CDH.

I would like to ask if there is any architectural change that makes column 
updates slower than Hive 1 in Hive 3 and later versions.

Thank you.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)


[jira] [Created] (HIVE-25729) ThriftUnionObjectInspector should be notified when fully inited

2021-11-21 Thread Zhihua Deng (Jira)
Zhihua Deng created HIVE-25729:
--

 Summary: ThriftUnionObjectInspector should be notified when fully 
inited
 Key: HIVE-25729
 URL: https://issues.apache.org/jira/browse/HIVE-25729
 Project: Hive
  Issue Type: Bug
  Components: Serializers/Deserializers
Reporter: Zhihua Deng


For thread safe purpose,  a ReflectionStructObjectInspector instance would wait 
for 3 seconds to ensure the returning ObjectInspector is fully inited, 
{code:java}
synchronized (soi) {
  while (!soi.isFullyInited(checkedTypes)) {
//   
    soi.wait(3000);  
  }
} {code}
It seems that we are missing to notify ThriftUnionObjectInspector when it has 
been inited.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)