[hive] branch master updated: HIVE-25782: Added client capabilites in the dry run call for the CTAS… (#2858) (Sai Hemanth Gantasala reviewed by Zoltan Haindrich)
This is an automated email from the ASF dual-hosted git repository.
kgyrtkirk pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/hive.git
The following commit(s) were added to refs/heads/master by this push:
new decd725 HIVE-25782: Added client capabilites in the dry run call for
the CTAS… (#2858) (Sai Hemanth Gantasala reviewed by Zoltan Haindrich)
decd725 is described below
commit decd725f2b29c37fa265edfc7899623c99916d61
Author: Sai Hemanth Gantasala
<68923650+saihemanth-cloud...@users.noreply.github.com>
AuthorDate: Wed Dec 15 22:57:41 2021 -0800
HIVE-25782: Added client capabilites in the dry run call for the CTAS…
(#2858) (Sai Hemanth Gantasala reviewed by Zoltan Haindrich)
---
.../create_acid_table_with_transformer.q | 7 +
.../llap/create_acid_table_with_transformer.q.out | 11 ++
.../src/gen/thrift/gen-cpp/ThriftHiveMetastore.cpp | 30 ++---
.../src/gen/thrift/gen-cpp/ThriftHiveMetastore.h | 30 ++---
.../ThriftHiveMetastore_server.skeleton.cpp| 2 +-
.../hive/metastore/api/ThriftHiveMetastore.java| 146 ++---
.../metastore/ThriftHiveMetastoreClient.php| 8 +-
.../gen-php/metastore/ThriftHiveMetastoreIf.php| 4 +-
...ftHiveMetastore_translate_table_dryrun_args.php | 24 ++--
.../hive_metastore/ThriftHiveMetastore-remote | 2 +-
.../gen-py/hive_metastore/ThriftHiveMetastore.py | 34 ++---
.../src/gen/thrift/gen-rb/thrift_hive_metastore.rb | 14 +-
.../hadoop/hive/metastore/HiveMetaStoreClient.java | 8 +-
.../src/main/thrift/hive_metastore.thrift | 3 +-
.../apache/hadoop/hive/metastore/HMSHandler.java | 7 +-
.../metastore/HiveMetaStoreClientPreCatalog.java | 3 +-
16 files changed, 181 insertions(+), 152 deletions(-)
diff --git
a/ql/src/test/queries/clientpositive/create_acid_table_with_transformer.q
b/ql/src/test/queries/clientpositive/create_acid_table_with_transformer.q
new file mode 100644
index 000..2547549
--- /dev/null
+++ b/ql/src/test/queries/clientpositive/create_acid_table_with_transformer.q
@@ -0,0 +1,7 @@
+set hive.support.concurrency=true;
+set hive.exec.dynamic.partition.mode=nonstrict;
+set hive.txn.manager=org.apache.hadoop.hive.ql.lockmgr.DbTxnManager;
+set
metastore.metadata.transformer.class=org.apache.hadoop.hive.metastore.MetastoreDefaultTransformer;
+set
hive.metastore.client.capabilities=HIVEFULLACIDREAD,HIVEFULLACIDWRITE,HIVECACHEINVALIDATE,HIVEMANAGESTATS,HIVEMANAGEDINSERTWRITE,HIVEMANAGEDINSERTREAD;
+
+create table test stored as orc tblproperties ('transactional'='true') as
select from_unixtime(unix_timestamp("0002-01-01 09:57:21", "-MM-dd
HH:mm:ss"));
diff --git
a/ql/src/test/results/clientpositive/llap/create_acid_table_with_transformer.q.out
b/ql/src/test/results/clientpositive/llap/create_acid_table_with_transformer.q.out
new file mode 100644
index 000..550a020
--- /dev/null
+++
b/ql/src/test/results/clientpositive/llap/create_acid_table_with_transformer.q.out
@@ -0,0 +1,11 @@
+PREHOOK: query: create table test stored as orc tblproperties
('transactional'='true') as select from_unixtime(unix_timestamp("0002-01-01
09:57:21", "-MM-dd HH:mm:ss"))
+PREHOOK: type: CREATETABLE_AS_SELECT
+PREHOOK: Input: _dummy_database@_dummy_table
+PREHOOK: Output: database:default
+PREHOOK: Output: default@test
+POSTHOOK: query: create table test stored as orc tblproperties
('transactional'='true') as select from_unixtime(unix_timestamp("0002-01-01
09:57:21", "-MM-dd HH:mm:ss"))
+POSTHOOK: type: CREATETABLE_AS_SELECT
+POSTHOOK: Input: _dummy_database@_dummy_table
+POSTHOOK: Output: database:default
+POSTHOOK: Output: default@test
+POSTHOOK: Lineage: test._c0 SIMPLE []
diff --git
a/standalone-metastore/metastore-common/src/gen/thrift/gen-cpp/ThriftHiveMetastore.cpp
b/standalone-metastore/metastore-common/src/gen/thrift/gen-cpp/ThriftHiveMetastore.cpp
index b07edc8..d08962f 100644
---
a/standalone-metastore/metastore-common/src/gen/thrift/gen-cpp/ThriftHiveMetastore.cpp
+++
b/standalone-metastore/metastore-common/src/gen/thrift/gen-cpp/ThriftHiveMetastore.cpp
@@ -9684,8 +9684,8 @@ uint32_t
ThriftHiveMetastore_translate_table_dryrun_args::read(::apache::thrift:
{
case 1:
if (ftype == ::apache::thrift::protocol::T_STRUCT) {
- xfer += this->tbl.read(iprot);
- this->__isset.tbl = true;
+ xfer += this->request.read(iprot);
+ this->__isset.request = true;
} else {
xfer += iprot->skip(ftype);
}
@@ -9707,8 +9707,8 @@ uint32_t
ThriftHiveMetastore_translate_table_dryrun_args::write(::apache::thrift
::apache::thrift::protocol::TOutputRecursionTracker tracker(*oprot);
xfer +=
oprot->writeStructBegin("ThriftHiveMetastore_translate_table_dryrun_args");
- xfer += oprot->writeFieldBegin("tbl", ::apache::thrift::protocol::T_STRUCT,
1);
- xfer += this->tbl.write(oprot);
+ xfer += oprot->writeFieldBegin("request",
[hive] branch branch-3 updated: HIVE-25709: Upgrading netty binaries to newer release (Naveen Gangam reviewed by Yongzhi Chen)
This is an automated email from the ASF dual-hosted git repository. ngangam pushed a commit to branch branch-3 in repository https://gitbox.apache.org/repos/asf/hive.git The following commit(s) were added to refs/heads/branch-3 by this push: new 5acad9f HIVE-25709: Upgrading netty binaries to newer release (Naveen Gangam reviewed by Yongzhi Chen) 5acad9f is described below commit 5acad9fe8095343fdc02cb056de4289696be37e7 Author: Naveen Gangam AuthorDate: Wed Dec 15 16:14:57 2021 -0500 HIVE-25709: Upgrading netty binaries to newer release (Naveen Gangam reviewed by Yongzhi Chen) --- pom.xml | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/pom.xml b/pom.xml index 40087d8..59295b8 100644 --- a/pom.xml +++ b/pom.xml @@ -188,7 +188,7 @@ 1.10.19 1.7.4 2.0.0-M5 -4.1.17.Final +4.1.69.Final 3.10.5.Final 1.10.0 0.16.0
[hive] branch branch-3 updated: HIVE-25795: Update log4j2 version to 2.16.0 for branch-3 (Naveen Gangam)
This is an automated email from the ASF dual-hosted git repository.
ngangam pushed a commit to branch branch-3
in repository https://gitbox.apache.org/repos/asf/hive.git
The following commit(s) were added to refs/heads/branch-3 by this push:
new 63a056a HIVE-25795: Update log4j2 version to 2.16.0 for branch-3
(Naveen Gangam)
63a056a is described below
commit 63a056ae87de739ba2ea66fd4001f529357a4aa1
Author: Naveen Gangam
AuthorDate: Wed Dec 15 15:57:45 2021 -0500
HIVE-25795: Update log4j2 version to 2.16.0 for branch-3 (Naveen Gangam)
---
bin/hive-config.sh | 4
pom.xml| 2 +-
.../apache/hadoop/hive/ql/log/SlidingFilenameRolloverStrategy.java | 4
standalone-metastore/pom.xml | 7 ++-
testutils/ptest2/pom.xml | 2 +-
5 files changed, 16 insertions(+), 3 deletions(-)
diff --git a/bin/hive-config.sh b/bin/hive-config.sh
index d52b84e..8381a25 100644
--- a/bin/hive-config.sh
+++ b/bin/hive-config.sh
@@ -68,3 +68,7 @@ export HIVE_AUX_JARS_PATH=$HIVE_AUX_JARS_PATH
# Default to use 256MB
export HADOOP_HEAPSIZE=${HADOOP_HEAPSIZE:-256}
+
+# Disable the JNDI. This feature has critical RCE vulnerability.
+# when 2.x <= log4j.version <= 2.14.1
+export HADOOP_CLIENT_OPTS="$HADOOP_CLIENT_OPTS
-Dlog4j2.formatMsgNoLookups=true"
diff --git a/pom.xml b/pom.xml
index 96e0217..40087d8 100644
--- a/pom.xml
+++ b/pom.xml
@@ -182,7 +182,7 @@
3.0.3
0.9.3
0.9.3
-2.10.0
+2.16.0
2.3
1.5.6
1.10.19
diff --git
a/ql/src/java/org/apache/hadoop/hive/ql/log/SlidingFilenameRolloverStrategy.java
b/ql/src/java/org/apache/hadoop/hive/ql/log/SlidingFilenameRolloverStrategy.java
index 664734c..67bbd8e 100644
---
a/ql/src/java/org/apache/hadoop/hive/ql/log/SlidingFilenameRolloverStrategy.java
+++
b/ql/src/java/org/apache/hadoop/hive/ql/log/SlidingFilenameRolloverStrategy.java
@@ -73,6 +73,10 @@ public class SlidingFilenameRolloverStrategy
return getLogFileName(pattern);
}
+ @Override public void clearCurrentFileName() {
+// no rename is needed
+ }
+
/**
* @return Mangled file name formed by appending the current timestamp
*/
diff --git a/standalone-metastore/pom.xml b/standalone-metastore/pom.xml
index 04eca50..7599882 100644
--- a/standalone-metastore/pom.xml
+++ b/standalone-metastore/pom.xml
@@ -78,7 +78,7 @@
4.11
0.9.3
0.9.3
-2.8.2
+2.16.0
1.10.19
1.5.1
2.5.0
@@ -265,6 +265,11 @@
${log4j2.version}
+ org.apache.logging.log4j
+ log4j-core
+ ${log4j2.version}
+
+
org.apache.thrift
libfb303
${libfb303.version}
diff --git a/testutils/ptest2/pom.xml b/testutils/ptest2/pom.xml
index 10dda97..450c158 100644
--- a/testutils/ptest2/pom.xml
+++ b/testutils/ptest2/pom.xml
@@ -26,7 +26,7 @@ limitations under the License.
hive-ptest
UTF-8
-2.10.0
+2.16.0
3.2.16.RELEASE
2.0.0
${basedir}/../../checkstyle/
[hive] branch master updated: HIVE-25804: Update log4j2 version to 2.16.0 to incorporate further CVE-2021-44228 hardening (#2874) (Csaba Juhász reviewed by Zoltan Haindrich)
This is an automated email from the ASF dual-hosted git repository. kgyrtkirk pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hive.git The following commit(s) were added to refs/heads/master by this push: new 6f29c1a HIVE-25804: Update log4j2 version to 2.16.0 to incorporate further CVE-2021-44228 hardening (#2874) (Csaba Juhász reviewed by Zoltan Haindrich) 6f29c1a is described below commit 6f29c1acf04fa1f1b84a6fb86f92bdc65b584567 Author: csjuhasz-c <66361392+csjuhas...@users.noreply.github.com> AuthorDate: Wed Dec 15 10:12:38 2021 +0100 HIVE-25804: Update log4j2 version to 2.16.0 to incorporate further CVE-2021-44228 hardening (#2874) (Csaba Juhász reviewed by Zoltan Haindrich) --- pom.xml | 2 +- standalone-metastore/pom.xml | 2 +- 2 files changed, 2 insertions(+), 2 deletions(-) diff --git a/pom.xml b/pom.xml index 710c1be..2fb29f6 100644 --- a/pom.xml +++ b/pom.xml @@ -178,7 +178,7 @@ 0.9.3 0.14.1 -2.15.0 +2.16.0 2.5.0 6.2.1.jre8 8.0.27 diff --git a/standalone-metastore/pom.xml b/standalone-metastore/pom.xml index bd331e3..34cdaab 100644 --- a/standalone-metastore/pom.xml +++ b/standalone-metastore/pom.xml @@ -91,7 +91,7 @@ 5.6.2 0.9.3 0.14.1 -2.15.0 +2.16.0 3.3.3 1.6.9
