[jira] [Created] (HIVE-26263) Mysql metastore init tests are flaky
Alessandro Solimando created HIVE-26263:
---
Summary: Mysql metastore init tests are flaky
Key: HIVE-26263
URL: https://issues.apache.org/jira/browse/HIVE-26263
Project: Hive
Issue Type: Test
Components: Testing Infrastructure
Affects Versions: 4.0.0-alpha-2
Reporter: Alessandro Solimando
Similarly to HIVE-26084 (Oracle tests), also Mysql tests are failing similarly.
In both cases we use _:latest_ as docker image version, which is probably not
ideal.
Reporting the error for future reference:
{noformat}
[2022-05-24T14:07:52.127Z] + sudo tee -a /etc/hosts
[2022-05-24T14:07:52.127Z] + echo 127.0.0.1 dev_mysql
[2022-05-24T14:07:52.127Z] 127.0.0.1 dev_mysql
[2022-05-24T14:07:52.127Z] + . /etc/profile.d/confs.sh
[2022-05-24T14:07:52.127Z] ++ export MAVEN_OPTS=-Xmx2g
[2022-05-24T14:07:52.127Z] ++ MAVEN_OPTS=-Xmx2g
[2022-05-24T14:07:52.127Z] ++ export HADOOP_CONF_DIR=/etc/hadoop
[2022-05-24T14:07:52.127Z] ++ HADOOP_CONF_DIR=/etc/hadoop
[2022-05-24T14:07:52.127Z] ++ export HADOOP_LOG_DIR=/data/log
[2022-05-24T14:07:52.127Z] ++ HADOOP_LOG_DIR=/data/log
[2022-05-24T14:07:52.127Z] ++ export
'HADOOP_CLASSPATH=/etc/tez/:/active/tez/lib/*:/active/tez/*:/apps/lib/*'
[2022-05-24T14:07:52.127Z] ++
HADOOP_CLASSPATH='/etc/tez/:/active/tez/lib/*:/active/tez/*:/apps/lib/*'
[2022-05-24T14:07:52.127Z] ++ export HIVE_CONF_DIR=/etc/hive/
[2022-05-24T14:07:52.127Z] ++ HIVE_CONF_DIR=/etc/hive/
[2022-05-24T14:07:52.127Z] ++ export
PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/active/hive/bin:/active/hadoop/bin:/active/eclipse/:/active/maven/bin/:/active/protobuf/bin:/active/visualvm/bin:/active/kubebuilder/bin:/active/idea/bin
[2022-05-24T14:07:52.127Z] ++
PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/active/hive/bin:/active/hadoop/bin:/active/eclipse/:/active/maven/bin/:/active/protobuf/bin:/active/visualvm/bin:/active/kubebuilder/bin:/active/idea/bin
[2022-05-24T14:07:52.127Z] ++ . /etc/profile.d/java.sh
[2022-05-24T14:07:52.127Z] +++ export JAVA_HOME=/usr/lib/jvm/zulu-8-amd64/
[2022-05-24T14:07:52.127Z] +++ JAVA_HOME=/usr/lib/jvm/zulu-8-amd64/
[2022-05-24T14:07:52.127Z] + sw hive-dev
/home/jenkins/agent/workspace/hive-precommit_PR-3317
[2022-05-24T14:07:52.127Z] @ activating:
/home/jenkins/agent/workspace/hive-precommit_PR-3317/packaging/target/apache-hive-4.0.0-alpha-2-SNAPSHOT-bin/apache-hive-4.0.0-alpha-2-SNAPSHOT-bin/
for hive
[2022-05-24T14:07:52.127Z] + ping -c2 dev_mysql
[2022-05-24T14:07:52.127Z] PING dev_mysql (127.0.0.1) 56(84) bytes of data.
[2022-05-24T14:07:52.127Z] 64 bytes from localhost (127.0.0.1): icmp_seq=1
ttl=64 time=0.114 ms
[2022-05-24T14:07:53.107Z] 64 bytes from localhost (127.0.0.1): icmp_seq=2
ttl=64 time=0.123 ms
[2022-05-24T14:07:53.107Z]
[2022-05-24T14:07:53.107Z] --- dev_mysql ping statistics ---
[2022-05-24T14:07:53.107Z] 2 packets transmitted, 2 received, 0% packet loss,
time 49ms
[2022-05-24T14:07:53.107Z] rtt min/avg/max/mdev = 0.114/0.118/0.123/0.011 ms
[2022-05-24T14:07:53.107Z] + export DOCKER_NETWORK=host
[2022-05-24T14:07:53.107Z] + DOCKER_NETWORK=host
[2022-05-24T14:07:53.107Z] + export DBNAME=metastore
[2022-05-24T14:07:53.107Z] + DBNAME=metastore
[2022-05-24T14:07:53.107Z] + reinit_metastore mysql
[2022-05-24T14:07:53.107Z] @ initializing: mysql
[2022-05-24T14:07:53.107Z] metastore database name: metastore
[2022-05-24T14:07:53.381Z] @ starting dev_mysql...
[2022-05-24T14:07:53.382Z] Unable to find image 'mariadb:latest' locally
[2022-05-24T14:07:54.354Z] latest: Pulling from library/mariadb
[2022-05-24T14:07:54.354Z] 125a6e411906: Pulling fs layer
[2022-05-24T14:07:54.354Z] a28b55cc656d: Pulling fs layer
[2022-05-24T14:07:54.354Z] f2325f4e25a1: Pulling fs layer
[2022-05-24T14:07:54.354Z] c6c2d09f748d: Pulling fs layer
[2022-05-24T14:07:54.354Z] af2b4ed853d2: Pulling fs layer
[2022-05-24T14:07:54.354Z] 8394ac6b401e: Pulling fs layer
[2022-05-24T14:07:54.354Z] 5b150cf0c5a7: Pulling fs layer
[2022-05-24T14:07:54.354Z] 1b11b2e20899: Pulling fs layer
[2022-05-24T14:07:54.354Z] 3d35790a91d9: Pulling fs layer
[2022-05-24T14:07:54.354Z] 5e73c7793365: Pulling fs layer
[2022-05-24T14:07:54.354Z] 3d34b9f14ede: Pulling fs layer
[2022-05-24T14:07:54.354Z] c6c2d09f748d: Waiting
[2022-05-24T14:07:54.354Z] 8394ac6b401e: Waiting
[2022-05-24T14:07:54.354Z] 5b150cf0c5a7: Waiting
[2022-05-24T14:07:54.354Z] 3d35790a91d9: Waiting
[2022-05-24T14:07:54.354Z] 5e73c7793365: Waiting
[2022-05-24T14:07:54.354Z] 3d34b9f14ede: Waiting
[2022-05-24T14:07:54.354Z] af2b4ed853d2: Waiting
[2022-05-24T14:07:54.624Z] a28b55cc656d: Verifying Checksum
[2022-05-24T14:07:54.624Z] a28b55cc656d: Download complete
[2022-05-24T14:07:54.624Z] f2325f4e25a1: Verifying Checksum
[2022-05-24T14:07:54.624Z] f2325f4e25a1: Download complete
[2022-05-24T14:07:54.918Z] af2b4ed853d2: Download complete
[2022-05-24T14:07:54.918Z] c6c2d09f748d: Verifying Chec
[jira] [Created] (HIVE-26262) Fix flaky TestReplicationMetricSink tests
Peter Vary created HIVE-26262:
-
Summary: Fix flaky TestReplicationMetricSink tests
Key: HIVE-26262
URL: https://issues.apache.org/jira/browse/HIVE-26262
Project: Hive
Issue Type: Test
Reporter: Peter Vary
The tests are flaky. See: [http://ci.hive.apache.org/job/hive-flaky-check/564/]
{code:java}
Test Result (2 failures / +2)
org.apache.hadoop.hive.ql.parse.repl.metric.TestReplicationMetricSink.testReplStatsInMetrics
org.apache.hadoop.hive.ql.parse.repl.metric.TestReplicationMetricSink.testSuccessBootstrapDumpMetrics
{code}
{code}
com.fasterxml.jackson.core.JsonParseException:
Unrecognized token 'ERROR': was expecting (JSON String, Number, Array, Object
or token 'null', 'true' or 'false')
at [Source: (String)"ERROR: RM_PROGRESS LIMIT EXCEEDED."; line: 1, column: 6]
at
com.fasterxml.jackson.core.JsonParser._constructError(JsonParser.java:1922)
at
com.fasterxml.jackson.core.base.ParserMinimalBase._reportError(ParserMinimalBase.java:720)
at
com.fasterxml.jackson.core.json.ReaderBasedJsonParser._reportInvalidToken(ReaderBasedJsonParser.java:2903)
at
com.fasterxml.jackson.core.json.ReaderBasedJsonParser._handleOddValue(ReaderBasedJsonParser.java:1949)
at
com.fasterxml.jackson.core.json.ReaderBasedJsonParser.nextToken(ReaderBasedJsonParser.java:781)
at
com.fasterxml.jackson.databind.ObjectMapper._initForReading(ObjectMapper.java:4682)
at
com.fasterxml.jackson.databind.ObjectMapper._readMapAndClose(ObjectMapper.java:4584)
at
com.fasterxml.jackson.databind.ObjectMapper.readValue(ObjectMapper.java:3546)
at
com.fasterxml.jackson.databind.ObjectMapper.readValue(ObjectMapper.java:3514)
at
org.apache.hadoop.hive.ql.parse.repl.metric.TestReplicationMetricSink.testSuccessBootstrapDumpMetrics(TestReplicationMetricSink.java:136)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at
org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59)
at
org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at
org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56)
at
org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
at
org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
at
org.mockito.internal.runners.DefaultInternalRunner$1$1.evaluate(DefaultInternalRunner.java:54)
at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
at
org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100)
at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366)
at
org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103)
at
org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63)
at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
at
org.mockito.internal.runners.DefaultInternalRunner$1.run(DefaultInternalRunner.java:99)
at
org.mockito.internal.runners.DefaultInternalRunner.run(DefaultInternalRunner.java:105)
at org.mockito.internal.runners.StrictRunner.run(StrictRunner.java:40)
at org.mockito.junit.MockitoJUnitRunner.run(MockitoJUnitRunner.java:163)
at org.junit.runner.JUnitCore.run(JUnitCore.java:137)
at org.junit.runner.JUnitCore.run(JUnitCore.java:115)
at
org.junit.vintage.engine.execution.RunnerExecutor.execute(RunnerExecutor.java:43)
at
java.util.stream.ForEachOps$ForEachOp$OfRef.accept(ForEachOps.java:183)
at
java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)
at java.util.Iterator.forEachRemaining(Iterator.java:116)
at
java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)
at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482)
at
java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472)
at
java.util.stream.ForEachOps$ForEachOp.evaluateSequential(ForEachOps.java:150)
at
java.util.st
[jira] [Created] (HIVE-26261) Fix some issues with Spark engine removal
Peter Vary created HIVE-26261: - Summary: Fix some issues with Spark engine removal Key: HIVE-26261 URL: https://issues.apache.org/jira/browse/HIVE-26261 Project: Hive Issue Type: Improvement Reporter: Peter Vary Assignee: Peter Vary I have made some mistakes when removed the Spark code: * CommandAuthorizerV2.java - should check the properties. At that stage the authorizer was referring tables created by Spark as a HMS client, and not as an engine * There is one unused method left in MapJoinTableContainerSerDe.java -- This message was sent by Atlassian Jira (v8.20.7#820007)
