[hive] branch master updated: HIVE-25741: HiveProtoLoggingHook EventLogger should always close old writer (Marton Bod, reviewed by Peter Vary)

2021-11-29 Thread mbod
This is an automated email from the ASF dual-hosted git repository.

mbod pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/hive.git


The following commit(s) were added to refs/heads/master by this push:
 new 1046f41  HIVE-25741: HiveProtoLoggingHook EventLogger should always 
close old writer (Marton Bod, reviewed by Peter Vary)
1046f41 is described below

commit 1046f41ea36ab3c8b036481128ba9b76dda2882a
Author: Marton Bod 
AuthorDate: Mon Nov 29 14:58:48 2021 +0100

HIVE-25741: HiveProtoLoggingHook EventLogger should always close old writer 
(Marton Bod, reviewed by Peter Vary)
---
 .../java/org/apache/hadoop/hive/ql/hooks/HiveProtoLoggingHook.java | 7 ---
 1 file changed, 4 insertions(+), 3 deletions(-)

diff --git 
a/ql/src/java/org/apache/hadoop/hive/ql/hooks/HiveProtoLoggingHook.java 
b/ql/src/java/org/apache/hadoop/hive/ql/hooks/HiveProtoLoggingHook.java
index e347002..e9ffc43 100644
--- a/ql/src/java/org/apache/hadoop/hive/ql/hooks/HiveProtoLoggingHook.java
+++ b/ql/src/java/org/apache/hadoop/hive/ql/hooks/HiveProtoLoggingHook.java
@@ -313,9 +313,10 @@ public class HiveProtoLoggingHook implements 
ExecuteWithHookContext {
   for (int retryCount = 0; retryCount <= MAX_RETRIES; ++retryCount) {
 try {
   if (eventPerFile) {
-if (!maybeRolloverWriterForDay()) {
-  writer = logger.getWriter(logFileName + "_" + ++logFileCount);
+if (writer != null) {
+  IOUtils.closeQuietly(writer);
 }
+writer = logger.getWriter(logFileName + "_" + ++logFileCount);
 LOG.debug("Event per file enabled. New proto event file: {}", 
writer.getPath());
 writer.writeProto(event);
 IOUtils.closeQuietly(writer);
@@ -333,7 +334,7 @@ public class HiveProtoLoggingHook implements 
ExecuteWithHookContext {
   if (retryCount < MAX_RETRIES) {
 LOG.warn("Error writing proto message for query {}, eventType: {}, 
retryCount: {}," +
 " error: {} ", event.getHiveQueryId(), event.getEventType(), 
retryCount,
-e.getMessage());
+e.getMessage(), e);
 LOG.trace("Exception", e);
   } else {
 LOG.error("Error writing proto message for query {}, eventType: 
{}: ",


[hive] branch master updated (63bb7b9 -> b5fafcd)

2021-11-29 Thread pvary
This is an automated email from the ASF dual-hosted git repository.

pvary pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/hive.git.


from 63bb7b9  HIVE-25561: Killed task should not commit file. (#2674) 
(zhengchenyu reviewed by Zoltan Haindrich)
 add b5fafcd  HIVE-25736: Close ORC readers (Peter Vary reviewed by 
Panagiotis Garefalakis, Zhihua Deng and Marton Bod) (#2813)

No new revisions were added by this update.

Summary of changes:
 .../org/apache/hadoop/hive/ql/TestAcidOnTez.java   |   9 +-
 .../hive/ql/txn/compactor/TestCompactor.java   |  14 +-
 .../hadoop/hive/ql/exec/OrcFileMergeOperator.java  |  12 +
 .../hadoop/hive/ql/hooks/PostExecOrcFileDump.java  |   6 +-
 .../hadoop/hive/ql/io/orc/FixAcidKeyIndex.java | 151 +
 .../hadoop/hive/ql/io/orc/OrcFileFormatProxy.java  |  12 +-
 .../hadoop/hive/ql/io/orc/OrcInputFormat.java  |  30 +-
 .../hadoop/hive/ql/io/orc/OrcRawRecordMerger.java  |   6 +-
 .../ql/io/orc/VectorizedOrcAcidRowBatchReader.java | 377 +++--
 .../hive/ql/io/orc/VectorizedOrcInputFormat.java   |   5 +-
 .../hive/ql/io/orc/TestInputOutputFormat.java  |  26 +-
 .../hive/ql/io/orc/TestNewInputOutputFormat.java   |  12 +-
 .../apache/hadoop/hive/ql/io/orc/TestOrcFile.java  |  11 +
 .../hive/ql/io/orc/TestOrcRecordUpdater.java   |   4 +
 .../hadoop/hive/ql/io/orc/TestOrcSerDeStats.java   |   6 +
 .../ql/txn/compactor/CompactorTestUtilities.java   |  15 +-
 .../org/apache/hive/streaming/TestStreaming.java   |  23 +-
 17 files changed, 389 insertions(+), 330 deletions(-)