[hive] branch master updated (4dd2072 -> 00abedb)
This is an automated email from the ASF dual-hosted git repository. pvarga pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hive.git. from 4dd2072 HIVE-24797: Disable validate default values when parsing Avro schemas (#1994) add 00abedb HIVE-24738: Reuse committed filelist from directinsert manifest during loadPartition (Peter Varga reviewed by Denys Kuzmenko, Peter Vary) No new revisions were added by this update. Summary of changes: .../java/org/apache/hadoop/hive/ql/QueryPlan.java | 2 +- .../org/apache/hadoop/hive/ql/exec/MoveTask.java | 2 +- .../org/apache/hadoop/hive/ql/exec/Utilities.java | 33 +++--- .../org/apache/hadoop/hive/ql/metadata/Hive.java | 27 ++ .../apache/hadoop/hive/ql/plan/FileSinkDesc.java | 10 +-- 5 files changed, 54 insertions(+), 20 deletions(-)
[hive] branch branch-2.3 updated: HIVE-24797: Disable validate default values when parsing Avro schemas (#1994)
This is an automated email from the ASF dual-hosted git repository.
sunchao pushed a commit to branch branch-2.3
in repository https://gitbox.apache.org/repos/asf/hive.git
The following commit(s) were added to refs/heads/branch-2.3 by this push:
new 324f9fa HIVE-24797: Disable validate default values when parsing Avro
schemas (#1994)
324f9fa is described below
commit 324f9faf12d4b91a9359391810cb3312c004d356
Author: Yuming Wang
AuthorDate: Wed Feb 24 01:59:51 2021 +0800
HIVE-24797: Disable validate default values when parsing Avro schemas
(#1994)
---
.../org/apache/hadoop/hive/serde2/avro/AvroSerdeUtils.java | 14 --
1 file changed, 8 insertions(+), 6 deletions(-)
diff --git
a/serde/src/java/org/apache/hadoop/hive/serde2/avro/AvroSerdeUtils.java
b/serde/src/java/org/apache/hadoop/hive/serde2/avro/AvroSerdeUtils.java
index 79d31c7..0de690c 100644
--- a/serde/src/java/org/apache/hadoop/hive/serde2/avro/AvroSerdeUtils.java
+++ b/serde/src/java/org/apache/hadoop/hive/serde2/avro/AvroSerdeUtils.java
@@ -263,17 +263,20 @@ public class AvroSerdeUtils {
return dec;
}
+ private static Schema.Parser getSchemaParser() {
+// HIVE-24797: Disable validate default values when parsing Avro schemas.
+return new Schema.Parser().setValidateDefaults(false);
+ }
+
public static Schema getSchemaFor(String str) {
-Schema.Parser parser = new Schema.Parser();
-Schema schema = parser.parse(str);
+Schema schema = getSchemaParser().parse(str);
return schema;
}
public static Schema getSchemaFor(File file) {
-Schema.Parser parser = new Schema.Parser();
Schema schema;
try {
- schema = parser.parse(file);
+ schema = getSchemaParser().parse(file);
} catch (IOException e) {
throw new RuntimeException("Failed to parse Avro schema from " +
file.getName(), e);
}
@@ -281,10 +284,9 @@ public class AvroSerdeUtils {
}
public static Schema getSchemaFor(InputStream stream) {
-Schema.Parser parser = new Schema.Parser();
Schema schema;
try {
- schema = parser.parse(stream);
+ schema = getSchemaParser().parse(stream);
} catch (IOException e) {
throw new RuntimeException("Failed to parse Avro schema", e);
}
[hive] branch master updated (fae1c83 -> 4dd2072)
This is an automated email from the ASF dual-hosted git repository. sunchao pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hive.git. from fae1c83 HIVE-24768: Using jackson bom everywhere, so that it'll be easy to ma… (#1969) (Sai Hemanth Gantasala, reviewed by Kevin Risden) add 4dd2072 HIVE-24797: Disable validate default values when parsing Avro schemas (#1994) No new revisions were added by this update. Summary of changes: .../org/apache/hadoop/hive/serde2/avro/AvroSerdeUtils.java | 14 -- 1 file changed, 8 insertions(+), 6 deletions(-)
[hive] branch master updated (75fec20 -> fae1c83)
This is an automated email from the ASF dual-hosted git repository. ychena pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hive.git. from 75fec20 HIVE-24809: Build failure while resolving javax.el dependency (#2003) (Stamatis Zampetakis reviewed by Zoltan Haindrich) add fae1c83 HIVE-24768: Using jackson bom everywhere, so that it'll be easy to ma… (#1969) (Sai Hemanth Gantasala, reviewed by Kevin Risden) No new revisions were added by this update. Summary of changes: itests/qtest-druid/pom.xml | 2 -- standalone-metastore/pom.xml | 12 ++-- testutils/ptest2/pom.xml | 10 +++--- 3 files changed, 17 insertions(+), 7 deletions(-)
[hive] branch master updated (0e9c0ce -> 75fec20)
This is an automated email from the ASF dual-hosted git repository. kgyrtkirk pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hive.git. from 0e9c0ce HIVE-24808: Cache Parsed Dates (David Mollitor reviewed by Miklos Gergely) add 75fec20 HIVE-24809: Build failure while resolving javax.el dependency (#2003) (Stamatis Zampetakis reviewed by Zoltan Haindrich) No new revisions were added by this update. Summary of changes: itests/pom.xml | 12 standalone-metastore/metastore-tools/pom.xml | 4 2 files changed, 16 insertions(+)
[hive] branch master updated (1e4fc7a -> 0e9c0ce)
This is an automated email from the ASF dual-hosted git repository. dmollitor pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hive.git. from 1e4fc7a HIVE-24775: Incorrect null handling when rebuilding Materialized view incrementally (Krisztian Kasa, reviewed by Jesus Camacho Rodriguez) add 0e9c0ce HIVE-24808: Cache Parsed Dates (David Mollitor reviewed by Miklos Gergely) No new revisions were added by this update. Summary of changes: .../org/apache/hadoop/hive/common/type/Date.java | 17 +- .../org/apache/hive/common/util/DateParser.java| 70 -- .../apache/hive/common/util/TestDateParser.java| 16 ++--- .../exec/vector/expressions/CastStringToDate.java | 6 +- .../vector/expressions/TruncDateFromString.java| 3 +- .../vector/expressions/TruncDateFromTimestamp.java | 2 - .../vector/expressions/VectorUDFDateAddColCol.java | 11 ++-- .../expressions/VectorUDFDateAddColScalar.java | 7 +-- .../expressions/VectorUDFDateAddScalarCol.java | 3 +- .../hadoop/hive/ql/udf/generic/GenericUDFDate.java | 3 +- .../hive/ql/udf/generic/GenericUDFDateAdd.java | 3 +- 11 files changed, 91 insertions(+), 50 deletions(-)
