[jira] [Created] (HIVE-24597) Replication with timestamp type partition failing in HA case with same NS
Arko Sharma created HIVE-24597: -- Summary: Replication with timestamp type partition failing in HA case with same NS Key: HIVE-24597 URL: https://issues.apache.org/jira/browse/HIVE-24597 Project: Hive Issue Type: Bug Reporter: Arko Sharma Assignee: Arko Sharma -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-24596) Explain ddl for debugging
Rajesh Balamohan created HIVE-24596: --- Summary: Explain ddl for debugging Key: HIVE-24596 URL: https://issues.apache.org/jira/browse/HIVE-24596 Project: Hive Issue Type: Improvement Reporter: Rajesh Balamohan For debugging query issues, basic details like table schema, statistics, partition details, query plans are needed. It would be good to have "explain ddl" support, which can generate these details. This can help in recreating the schema and planner issues without sample data. -- This message was sent by Atlassian Jira (v8.3.4#803005)
Re: [VOTE] Apache Hive 2.3.8 Release Candidate 2
cc Alan Gates who's the last release manager for this branch. On Wed, Jan 6, 2021 at 12:16 PM Chao Sun wrote: > Sorry just saw your message Yuming. I built the dist following this doc: > https://cwiki.apache.org/confluence/display/Hive/HowToRelease#HowToRelease-HiveRelease, > with command: > > mvn install -Pdist -DskipTests -Dmaven.javadoc.skip=true -DcreateChecksum=true > > > and when I do the same for Hive 2.3.7, the result jars match mostly. > However the downloaded 2.3.7 distribution from > https://downloads.apache.org/hive/hive-2.3.7/ seems to be missing jars > such as spark/scala (which I assume is from Hive on Spark). I also checked > Hive 2.3.6 and it doesn't have those either. > > Anyone knows whether the packaging process has changed from the above doc? > > > > On Wed, Dec 16, 2020 at 4:26 PM Wang, Yuming > wrote: > >> >> Hive 2.3.8 has more jars than Hive 2.3.7. Is this we expected? >> >> diff --git a/2.3.7.jars b/2.3.8.jars >> index d40ebb932b..d18191bc98 100644 >> --- a/2.3.7.jars >> +++ b/2.3.8.jars >> @@ -22,17 +22,17 @@ asm-commons-3.1.jar >> asm-tree-3.1.jar >> avatica-1.8.0.jar >> avatica-metrics-1.8.0.jar >> -avro-1.7.7.jar >> +avro-1.8.2.jar >> +avro-ipc-1.8.2.jar >> +avro-mapred-1.8.2-hadoop2.jar >> bonecp-0.8.0.RELEASE.jar >> bytebuffer-collections-0.2.5.jar >> -calcite-core-1.10.0.jar >> -calcite-druid-1.10.0.jar >> -calcite-linq4j-1.10.0.jar >> +chill_2.11-0.8.0.jar >> +chill-java-0.8.0.jar >> classmate-1.0.0.jar >> commons-cli-1.2.jar >> commons-codec-1.4.jar >> commons-collections-3.2.2.jar >> -commons-compiler-2.7.6.jar >> commons-compress-1.9.jar >> commons-dbcp-1.4.jar >> commons-dbcp2-2.0.1.jar >> @@ -67,7 +67,6 @@ druid-console-0.0.2.jar >> druid-hdfs-storage-0.9.2.jar >> druid-processing-0.9.2.jar >> druid-server-0.9.2.jar >> -eigenbase-properties-1.1.5.jar >> emitter-0.3.6.jar >> extendedset-1.3.10.jar >> findbugs-annotations-1.3.9-1.jar >> @@ -94,36 +93,36 @@ hbase-protocol-1.1.1.jar >> hbase-server-1.1.1.jar >> hibernate-validator-5.1.3.Final.jar >> HikariCP-2.5.1.jar >> -hive-accumulo-handler-2.3.7.jar >> -hive-beeline-2.3.7.jar >> -hive-cli-2.3.7.jar >> -hive-common-2.3.7.jar >> -hive-contrib-2.3.7.jar >> -hive-druid-handler-2.3.7.jar >> -hive-exec-2.3.7.jar >> -hive-hbase-handler-2.3.7.jar >> -hive-hcatalog-core-2.3.7.jar >> -hive-hcatalog-server-extensions-2.3.7.jar >> -hive-hplsql-2.3.7.jar >> -hive-jdbc-2.3.7.jar >> -hive-jdbc-handler-2.3.7.jar >> -hive-llap-client-2.3.7.jar >> -hive-llap-common-2.3.7.jar >> -hive-llap-common-2.3.7-tests.jar >> -hive-llap-ext-client-2.3.7.jar >> -hive-llap-server-2.3.7.jar >> -hive-llap-tez-2.3.7.jar >> -hive-metastore-2.3.7.jar >> -hive-serde-2.3.7.jar >> -hive-service-2.3.7.jar >> -hive-service-rpc-2.3.7.jar >> -hive-shims-0.23-2.3.7.jar >> -hive-shims-2.3.7.jar >> -hive-shims-common-2.3.7.jar >> -hive-shims-scheduler-2.3.7.jar >> +hive-accumulo-handler-2.3.8.jar >> +hive-beeline-2.3.8.jar >> +hive-cli-2.3.8.jar >> +hive-common-2.3.8.jar >> +hive-contrib-2.3.8.jar >> +hive-druid-handler-2.3.8.jar >> +hive-exec-2.3.8.jar >> +hive-hbase-handler-2.3.8.jar >> +hive-hcatalog-core-2.3.8.jar >> +hive-hcatalog-server-extensions-2.3.8.jar >> +hive-hplsql-2.3.8.jar >> +hive-jdbc-2.3.8.jar >> +hive-jdbc-handler-2.3.8.jar >> +hive-llap-client-2.3.8.jar >> +hive-llap-common-2.3.8.jar >> +hive-llap-common-2.3.8-tests.jar >> +hive-llap-ext-client-2.3.8.jar >> +hive-llap-server-2.3.8.jar >> +hive-llap-tez-2.3.8.jar >> +hive-metastore-2.3.8.jar >> +hive-serde-2.3.8.jar >> +hive-service-2.3.8.jar >> +hive-service-rpc-2.3.8.jar >> +hive-shims-0.23-2.3.8.jar >> +hive-shims-2.3.8.jar >> +hive-shims-common-2.3.8.jar >> +hive-shims-scheduler-2.3.8.jar >> hive-storage-api-2.4.0.jar >> -hive-testutils-2.3.7.jar >> -hive-vector-code-gen-2.3.7.jar >> +hive-testutils-2.3.8.jar >> +hive-vector-code-gen-2.3.8.jar >> htrace-core-3.1.0-incubating.jar >> http-client-1.0.4.jar >> httpclient-4.4.jar >> @@ -133,6 +132,7 @@ irc-api-1.0-0014.jar >> ivy-2.4.0.jar >> jackson-annotations-2.6.0.jar >> jackson-core-2.6.5.jar >> +jackson-core-asl-1.9.13.jar >> jackson-databind-2.6.5.jar >> jackson-dataformat-smile-2.4.6.jar >> jackson-datatype-guava-2.4.6.jar >> @@ -141,12 +141,15 @@ jackson-jaxrs-1.9.13.jar >> jackson-jaxrs-base-2.4.6.jar >> jackson-jaxrs-json-provider-2.4.6.jar >> jackson-jaxrs-smile-provider-2.4.6.jar >> +jackson-mapper-asl-1.9.13.jar >> jackson-module-jaxb-annotations-2.4.6.jar >> +jackson-module-paranamer-2.6.5.jar >> +jackson-module-scala_2.11-2.6.5.jar >> jackson-xc-1.9.13.jar >> jamon-runtime-2.3.1.jar >> -janino-2.7.6.jar >> jasper-compiler-5.5.23.jar >> jasper-runtime-5.5.23.jar >> +JavaEWAH-0.3.2.jar >> java-util-0.27.10.jar >> javax.el-3.0.0.jar >> javax.el-api-3.0.0.jar >> @@ -180,10 +183,14 @@ jetty-util-6.1.26.jar >> jetty-util-9.2.5.v20141112.jar >> jline-2.12.jar >> joda-time-2.8.1.jar >> +jodd-core-3.5.2.jar >> jol-core-0.2.jar >> joni-2.1.2.jar >> jpam-1.1.jar >> json-1.8.jar >> +json4
Re: [VOTE] Apache Hive 2.3.8 Release Candidate 2
Sorry just saw your message Yuming. I built the dist following this doc: https://cwiki.apache.org/confluence/display/Hive/HowToRelease#HowToRelease-HiveRelease, with command: mvn install -Pdist -DskipTests -Dmaven.javadoc.skip=true -DcreateChecksum=true and when I do the same for Hive 2.3.7, the result jars match mostly. However the downloaded 2.3.7 distribution from https://downloads.apache.org/hive/hive-2.3.7/ seems to be missing jars such as spark/scala (which I assume is from Hive on Spark). I also checked Hive 2.3.6 and it doesn't have those either. Anyone knows whether the packaging process has changed from the above doc? On Wed, Dec 16, 2020 at 4:26 PM Wang, Yuming wrote: > > Hive 2.3.8 has more jars than Hive 2.3.7. Is this we expected? > > diff --git a/2.3.7.jars b/2.3.8.jars > index d40ebb932b..d18191bc98 100644 > --- a/2.3.7.jars > +++ b/2.3.8.jars > @@ -22,17 +22,17 @@ asm-commons-3.1.jar > asm-tree-3.1.jar > avatica-1.8.0.jar > avatica-metrics-1.8.0.jar > -avro-1.7.7.jar > +avro-1.8.2.jar > +avro-ipc-1.8.2.jar > +avro-mapred-1.8.2-hadoop2.jar > bonecp-0.8.0.RELEASE.jar > bytebuffer-collections-0.2.5.jar > -calcite-core-1.10.0.jar > -calcite-druid-1.10.0.jar > -calcite-linq4j-1.10.0.jar > +chill_2.11-0.8.0.jar > +chill-java-0.8.0.jar > classmate-1.0.0.jar > commons-cli-1.2.jar > commons-codec-1.4.jar > commons-collections-3.2.2.jar > -commons-compiler-2.7.6.jar > commons-compress-1.9.jar > commons-dbcp-1.4.jar > commons-dbcp2-2.0.1.jar > @@ -67,7 +67,6 @@ druid-console-0.0.2.jar > druid-hdfs-storage-0.9.2.jar > druid-processing-0.9.2.jar > druid-server-0.9.2.jar > -eigenbase-properties-1.1.5.jar > emitter-0.3.6.jar > extendedset-1.3.10.jar > findbugs-annotations-1.3.9-1.jar > @@ -94,36 +93,36 @@ hbase-protocol-1.1.1.jar > hbase-server-1.1.1.jar > hibernate-validator-5.1.3.Final.jar > HikariCP-2.5.1.jar > -hive-accumulo-handler-2.3.7.jar > -hive-beeline-2.3.7.jar > -hive-cli-2.3.7.jar > -hive-common-2.3.7.jar > -hive-contrib-2.3.7.jar > -hive-druid-handler-2.3.7.jar > -hive-exec-2.3.7.jar > -hive-hbase-handler-2.3.7.jar > -hive-hcatalog-core-2.3.7.jar > -hive-hcatalog-server-extensions-2.3.7.jar > -hive-hplsql-2.3.7.jar > -hive-jdbc-2.3.7.jar > -hive-jdbc-handler-2.3.7.jar > -hive-llap-client-2.3.7.jar > -hive-llap-common-2.3.7.jar > -hive-llap-common-2.3.7-tests.jar > -hive-llap-ext-client-2.3.7.jar > -hive-llap-server-2.3.7.jar > -hive-llap-tez-2.3.7.jar > -hive-metastore-2.3.7.jar > -hive-serde-2.3.7.jar > -hive-service-2.3.7.jar > -hive-service-rpc-2.3.7.jar > -hive-shims-0.23-2.3.7.jar > -hive-shims-2.3.7.jar > -hive-shims-common-2.3.7.jar > -hive-shims-scheduler-2.3.7.jar > +hive-accumulo-handler-2.3.8.jar > +hive-beeline-2.3.8.jar > +hive-cli-2.3.8.jar > +hive-common-2.3.8.jar > +hive-contrib-2.3.8.jar > +hive-druid-handler-2.3.8.jar > +hive-exec-2.3.8.jar > +hive-hbase-handler-2.3.8.jar > +hive-hcatalog-core-2.3.8.jar > +hive-hcatalog-server-extensions-2.3.8.jar > +hive-hplsql-2.3.8.jar > +hive-jdbc-2.3.8.jar > +hive-jdbc-handler-2.3.8.jar > +hive-llap-client-2.3.8.jar > +hive-llap-common-2.3.8.jar > +hive-llap-common-2.3.8-tests.jar > +hive-llap-ext-client-2.3.8.jar > +hive-llap-server-2.3.8.jar > +hive-llap-tez-2.3.8.jar > +hive-metastore-2.3.8.jar > +hive-serde-2.3.8.jar > +hive-service-2.3.8.jar > +hive-service-rpc-2.3.8.jar > +hive-shims-0.23-2.3.8.jar > +hive-shims-2.3.8.jar > +hive-shims-common-2.3.8.jar > +hive-shims-scheduler-2.3.8.jar > hive-storage-api-2.4.0.jar > -hive-testutils-2.3.7.jar > -hive-vector-code-gen-2.3.7.jar > +hive-testutils-2.3.8.jar > +hive-vector-code-gen-2.3.8.jar > htrace-core-3.1.0-incubating.jar > http-client-1.0.4.jar > httpclient-4.4.jar > @@ -133,6 +132,7 @@ irc-api-1.0-0014.jar > ivy-2.4.0.jar > jackson-annotations-2.6.0.jar > jackson-core-2.6.5.jar > +jackson-core-asl-1.9.13.jar > jackson-databind-2.6.5.jar > jackson-dataformat-smile-2.4.6.jar > jackson-datatype-guava-2.4.6.jar > @@ -141,12 +141,15 @@ jackson-jaxrs-1.9.13.jar > jackson-jaxrs-base-2.4.6.jar > jackson-jaxrs-json-provider-2.4.6.jar > jackson-jaxrs-smile-provider-2.4.6.jar > +jackson-mapper-asl-1.9.13.jar > jackson-module-jaxb-annotations-2.4.6.jar > +jackson-module-paranamer-2.6.5.jar > +jackson-module-scala_2.11-2.6.5.jar > jackson-xc-1.9.13.jar > jamon-runtime-2.3.1.jar > -janino-2.7.6.jar > jasper-compiler-5.5.23.jar > jasper-runtime-5.5.23.jar > +JavaEWAH-0.3.2.jar > java-util-0.27.10.jar > javax.el-3.0.0.jar > javax.el-api-3.0.0.jar > @@ -180,10 +183,14 @@ jetty-util-6.1.26.jar > jetty-util-9.2.5.v20141112.jar > jline-2.12.jar > joda-time-2.8.1.jar > +jodd-core-3.5.2.jar > jol-core-0.2.jar > joni-2.1.2.jar > jpam-1.1.jar > json-1.8.jar > +json4s-ast_2.11-3.2.11.jar > +json4s-core_2.11-3.2.11.jar > +json4s-jackson_2.11-3.2.11.jar > json-path-2.1.0.jar > jsp-2.1-6.1.14.jar > jsp-api-2.0.jar > @@ -191,6 +198,7 @@ jsp-api-2.1-6.1.14.jar > jsp-api-2.1.jar > jsr305-3.0.0.jar > jta-1.1.jar > +kryo-shaded-3.0.3.jar > libfb30
[jira] [Created] (HIVE-24595) Vectorization causing incorrect results for scalar subquery
Vineet Garg created HIVE-24595: -- Summary: Vectorization causing incorrect results for scalar subquery Key: HIVE-24595 URL: https://issues.apache.org/jira/browse/HIVE-24595 Project: Hive Issue Type: Bug Components: Vectorization Affects Versions: 3.0.0 Reporter: Vineet Garg *Repro* {code:sql} CREATE EXTERNAL TABLE `alltypessmall`( `id` int, `bool_col` boolean, `tinyint_col` tinyint, `smallint_col` smallint, `int_col` int, `bigint_col` bigint, `float_col` float, `double_col` double, `date_string_col` string, `string_col` string, `timestamp_col` timestamp) PARTITIONED BY ( `year` int, `month` int) ROW FORMAT SERDE 'org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe' WITH SERDEPROPERTIES ( 'escape.delim'='\\', 'field.delim'=',', 'serialization.format'=',') STORED AS INPUTFORMAT 'org.apache.hadoop.mapred.TextInputFormat' OUTPUTFORMAT 'org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat' TBLPROPERTIES ( 'DO_NOT_UPDATE_STATS'='true', 'OBJCAPABILITIES'='EXTREAD,EXTWRITE', 'STATS_GENERATED'='TASK', 'impala.lastComputeStatsTime'='1608312793', 'transient_lastDdlTime'='1608310442'); insert into alltypessmall partition(year=2002,month=1) values(1, true, 3,3,4,3434,5.4,44.3,'str1','str2', '01-01-2001'); insert into alltypessmall partition(year=2002,month=1) values(1, true, 3,3,4,3434,5.4,44.3,'str1','str2', '01-01-2001'); insert into alltypessmall partition(year=2002,month=1) values(1, true, 3,3,40,3434,5.4,44.3,'str1','str2', '01-01-2001'); {code} Following query should fail but it succeeds {code:sql} SELECT id FROM alltypessmall WHERE int_col = (SELECT int_col FROM alltypessmall) ORDER BY id; {code} *Explain plan* {code:java} STAGE DEPENDENCIES: Stage-1 is a root stage Stage-0 depends on stages: Stage-1 STAGE PLANS: Stage: Stage-1 Tez DagId: vgarg_20210106115838_3fe73bf6-66c2-4281-92e8-fd75fd8ad400:17 Edges: Map 1 <- Map 3 (BROADCAST_EDGE), Reducer 4 (BROADCAST_EDGE) Reducer 2 <- Map 1 (SIMPLE_EDGE) Reducer 4 <- Map 3 (CUSTOM_SIMPLE_EDGE) DagName: vgarg_20210106115838_3fe73bf6-66c2-4281-92e8-fd75fd8ad400:17 Vertices: Map 1 Map Operator Tree: TableScan alias: alltypessmall filterExpr: int_col is not null (type: boolean) Statistics: Num rows: 3 Data size: 24 Basic stats: COMPLETE Column stats: COMPLETE Filter Operator predicate: int_col is not null (type: boolean) Statistics: Num rows: 3 Data size: 24 Basic stats: COMPLETE Column stats: COMPLETE Select Operator expressions: id (type: int), int_col (type: int) outputColumnNames: _col0, _col1 Statistics: Num rows: 3 Data size: 24 Basic stats: COMPLETE Column stats: COMPLETE Map Join Operator condition map: Inner Join 0 to 1 keys: 0 1 outputColumnNames: _col0, _col1 input vertices: 1 Reducer 4 Statistics: Num rows: 3 Data size: 24 Basic stats: COMPLETE Column stats: COMPLETE Map Join Operator condition map: Inner Join 0 to 1 keys: 0 _col1 (type: int) 1 _col0 (type: int) outputColumnNames: _col0 input vertices: 1 Map 3 Statistics: Num rows: 9 Data size: 36 Basic stats: COMPLETE Column stats: COMPLETE Reduce Output Operator key expressions: _col0 (type: int) null sort order: z
[jira] [Created] (HIVE-24594) results_cache_invalidation2.q is flaky
Vihang Karajgaonkar created HIVE-24594: -- Summary: results_cache_invalidation2.q is flaky Key: HIVE-24594 URL: https://issues.apache.org/jira/browse/HIVE-24594 Project: Hive Issue Type: Test Reporter: Vihang Karajgaonkar Assignee: Vihang Karajgaonkar results_cache_invalidation2.q failed for me couple of times on a unrelated PR. Here is the error log. {noformat} --- Test set: org.apache.hadoop.hive.cli.split19.TestMiniLlapLocalCliDriver --- Tests run: 90, Failures: 1, Errors: 0, Skipped: 6, Time elapsed: 450.54 s <<< FAILURE! - in org.apache.hadoop.hive.cli.split19.TestMiniLlapLocalCliDriver org.apache.hadoop.hive.cli.split19.TestMiniLlapLocalCliDriver.testCliDriver[results_cache_invalidation2] Time elapsed: 15.087 s <<< FAILURE! java.lang.AssertionError: Client Execution succeeded but contained differences (error code = 1) after executing results_cache_invalidation2.q ^M 266a267 > A masked pattern was here 271a273 > A masked pattern was here 273c275,276 < Stage-0 is a root stage --- > Stage-1 is a root stage > Stage-0 depends on stages: Stage-1 275a279,365 > Stage: Stage-1 > Tez > A masked pattern was here > Edges: > Reducer 2 <- Map 1 (SIMPLE_EDGE), Map 4 (SIMPLE_EDGE) > Reducer 3 <- Reducer 2 (CUSTOM_SIMPLE_EDGE) > A masked pattern was here > Vertices: > Map 1 > Map Operator Tree: > TableScan > alias: tab1 > filterExpr: key is not null (type: boolean) > Statistics: Num rows: 1500 Data size: 130500 Basic stats: > COMPLETE Column stats: COMPLETE > Filter Operator > predicate: key is not null (type: boolean) > Statistics: Num rows: 1500 Data size: 130500 Basic stats: > COMPLETE Column stats: COMPLETE > Select Operator > expressions: key (type: string) > outputColumnNames: _col0 > Statistics: Num rows: 1500 Data size: 130500 Basic > stats: COMPLETE Column stats: COMPLETE > Reduce Output Operator > key expressions: _col0 (type: string) > null sort order: z > sort order: + > Map-reduce partition columns: _col0 (type: string) > Statistics: Num rows: 1500 Data size: 130500 Basic > stats: COMPLETE Column stats: COMPLETE > Execution mode: vectorized, llap > LLAP IO: all inputs > Map 4 > Map Operator Tree: > TableScan > alias: tab2 > filterExpr: key is not null (type: boolean) > Statistics: Num rows: 500 Data size: 43500 Basic stats: > COMPLETE Column stats: COMPLETE > Fil^M {noformat} The test works for me locally. In fact the same PR had a successful run of this test in a previous commit. I think we should disable this and re-enable it after fixing the flakiness. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-24593) Clean up checkstyle violations in ddl
Miklos Gergely created HIVE-24593: - Summary: Clean up checkstyle violations in ddl Key: HIVE-24593 URL: https://issues.apache.org/jira/browse/HIVE-24593 Project: Hive Issue Type: Sub-task Reporter: Miklos Gergely Assignee: Miklos Gergely -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-24592) Revert Hive-24550
David Mollitor created HIVE-24592: - Summary: Revert Hive-24550 Key: HIVE-24592 URL: https://issues.apache.org/jira/browse/HIVE-24592 Project: Hive Issue Type: Improvement Reporter: David Mollitor Assignee: David Mollitor Broke the build. {code:none} [ERROR] COMPILATION ERROR : [ERROR] /home/travis/build/apache/hive/itests/hive-unit/src/test/java/org/apache/hive/jdbc/miniHS2/TestHiveServer2Acid.java:[23,44] cannot find symbol symbol: class TxnDbUtil location: package org.apache.hadoop.hive.metastore.txn [ERROR] Failed to execute goal org.apache.maven.plugins:maven-compiler-plugin:3.8.1:testCompile (default-testCompile) on project hive-it-unit: Compilation failure [ERROR] /home/travis/build/apache/hive/itests/hive-unit/src/test/java/org/apache/hive/jdbc/miniHS2/TestHiveServer2Acid.java:[23,44] cannot find symbol [ERROR] symbol: class TxnDbUtil [ERROR] location: package org.apache.hadoop.hive.metastore.txn [ERROR] {code} -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-24591) Move Beeline To SLF4J Simple Logger
David Mollitor created HIVE-24591: - Summary: Move Beeline To SLF4J Simple Logger Key: HIVE-24591 URL: https://issues.apache.org/jira/browse/HIVE-24591 Project: Hive Issue Type: Improvement Components: Beeline Reporter: David Mollitor Assignee: David Mollitor To make beeline as simple as possible, move its SLF4J logger implementation to SLFJ-Simple logger. This will allow users to change the logging level simply on the command line. Currently uses must create a Log4J configuration file which is way too advance/cumbersome for a data analyst that just wants to use SQL (and do some minor troubleshooting) {code:none} beeline -Dorg.slf4j.simpleLogger.defaultLogLevel=debug ... {code} http://www.slf4j.org/api/org/slf4j/impl/SimpleLogger.html -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HIVE-24590) Operation Logging still leaks the log4j Appenders
Eugene Chung created HIVE-24590: --- Summary: Operation Logging still leaks the log4j Appenders Key: HIVE-24590 URL: https://issues.apache.org/jira/browse/HIVE-24590 Project: Hive Issue Type: Bug Components: Logging Reporter: Eugene Chung Attachments: Screen Shot 2021-01-06 at 18.42.05.png, Screen Shot 2021-01-06 at 18.42.24.png, Screen Shot 2021-01-06 at 18.42.55.png I'm using Hive 3.1.2 with options below. * hive.server2.logging.operation.enabled=true * hive.server2.logging.operation.level=VERBOSE * hive.async.log.enabled=false I already know the ticket, https://issues.apache.org/jira/browse/HIVE-17128 but it still leaks log4j RandomAccessFileManager. !Screen Shot 2021-01-06 at 18.42.05.png|width=756,height=197! I checked the operation log file which is not closed. !Screen Shot 2021-01-06 at 18.42.24.png|width=603,height=272! Then there's the log, {code:java} client.TezClient: Shutting down Tez Session, sessionName= {code} !Screen Shot 2021-01-06 at 18.42.55.png|width=1372,height=26! -- This message was sent by Atlassian Jira (v8.3.4#803005)