Funny. The specific IT passed locally for me. Seems more like a Jenkins setup to troubleshoot for us... Thanks for your help Ankit.
On Wed, Feb 20, 2019 at 12:07 PM William Shen <wills...@marinsoftware.com> wrote: > Thanks Ankit. > > What is the difference between these hive tests > (e.g., org.apache.phoenix.hive.HiveTezIT) and other tests that also use a > mini cluster > (org.apache.phoenix.end2end.MigrateSystemTablesToSystemNamespaceIT), which > are passing? Specifically, what does it need from HADOOP_HOME? > > On Tue, Feb 19, 2019 at 11:39 AM Ankit Singhal <ankitsingha...@gmail.com> > wrote: > >> you can check if HADOOP_HOME and JAVA_HOME are properly set in the >> environment. >> >> On Tue, Feb 19, 2019 at 11:23 AM William Shen <wills...@marinsoftware.com >> > >> wrote: >> >> > Hi everyone, >> > >> > I'm trying to set up the Jenkins job at work to build Phoenix and run >> the >> > integration tests. However, repeatedly I encounter issues with the hive >> > module when I run mvn verify. Does the hive integration tests require >> any >> > special set up for them to pass? The other modules passed integration >> > testing successfully. >> > >> > Attaching below is a sample failure trace. >> > >> > Thanks! >> > >> > - Will >> > >> > [ERROR] Tests run: 6, Failures: 6, Errors: 0, Skipped: 0, Time >> > elapsed: 48.302 s <<< FAILURE! - in >> > org.apache.phoenix.hive.HiveTezIT[ERROR] >> > simpleColumnMapTest(org.apache.phoenix.hive.HiveTezIT) Time elapsed: >> > 6.727 s <<< FAILURE!junit.framework.AssertionFailedError: >> > Unexpected exception java.lang.RuntimeException: >> > org.apache.tez.dag.api.SessionNotRunning: TezSession has already >> > shutdown. Application application_1550371508120_0001 failed 2 times >> > due to AM Container for appattempt_1550371508120_0001_000002 exited >> > with exitCode: 127 >> > For more detailed output, check application tracking >> > page: >> > >> http://40a4dd0e8959:38843/cluster/app/application_1550371508120_0001Then, >> > click on links to logs of each attempt. >> > Diagnostics: Exception from container-launch. >> > Container id: container_1550371508120_0001_02_000001 >> > Exit code: 127 >> > Stack trace: ExitCodeException exitCode=127: >> > at org.apache.hadoop.util.Shell.runCommand(Shell.java:545) >> > at org.apache.hadoop.util.Shell.run(Shell.java:456) >> > at >> > >> org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:722) >> > at >> > >> org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:211) >> > at >> > >> org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302) >> > at >> > >> org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82) >> > at java.util.concurrent.FutureTask.run(FutureTask.java:266) >> > at >> > >> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) >> > at >> > >> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) >> > at java.lang.Thread.run(Thread.java:748) >> > >> > >> > Container exited with a non-zero exit code 127 >> > Failing this attempt. Failing the application. >> > at >> > >> org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:535) >> > at >> > org.apache.phoenix.hive.HiveTestUtil.cliInit(HiveTestUtil.java:637) >> > at >> > org.apache.phoenix.hive.HiveTestUtil.cliInit(HiveTestUtil.java:590) >> > at >> > >> org.apache.phoenix.hive.BaseHivePhoenixStoreIT.runTest(BaseHivePhoenixStoreIT.java:117) >> > at >> > >> org.apache.phoenix.hive.HivePhoenixStoreIT.simpleColumnMapTest(HivePhoenixStoreIT.java:103) >> > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) >> > at >> > >> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) >> > at >> > >> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) >> > at java.lang.reflect.Method.invoke(Method.java:498) >> > at >> > >> org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) >> > at >> > >> org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) >> > at >> > >> org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) >> > at >> > >> org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) >> > at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325) >> > at >> > >> org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78) >> > at >> > >> org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57) >> > at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290) >> > at >> org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71) >> > at >> > org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288) >> > at >> org.junit.runners.ParentRunner.access$000(ParentRunner.java:58) >> > at >> org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268) >> > at >> > >> org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) >> > at >> > >> org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) >> > at org.junit.runners.ParentRunner.run(ParentRunner.java:363) >> > at org.junit.runners.Suite.runChild(Suite.java:128) >> > at org.junit.runners.Suite.runChild(Suite.java:27) >> > at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290) >> > at >> org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71) >> > at >> > org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288) >> > at >> org.junit.runners.ParentRunner.access$000(ParentRunner.java:58) >> > at >> org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268) >> > at org.junit.runners.ParentRunner.run(ParentRunner.java:363) >> > at >> > org.apache.maven.surefire.junitcore.JUnitCore.run(JUnitCore.java:55) >> > at >> > >> org.apache.maven.surefire.junitcore.JUnitCoreWrapper.createRequestAndRun(JUnitCoreWrapper.java:137) >> > at >> > >> org.apache.maven.surefire.junitcore.JUnitCoreWrapper.executeEager(JUnitCoreWrapper.java:107) >> > at >> > >> org.apache.maven.surefire.junitcore.JUnitCoreWrapper.execute(JUnitCoreWrapper.java:83) >> > at >> > >> org.apache.maven.surefire.junitcore.JUnitCoreWrapper.execute(JUnitCoreWrapper.java:75) >> > at >> > >> org.apache.maven.surefire.junitcore.JUnitCoreProvider.invoke(JUnitCoreProvider.java:157) >> > at >> > >> org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:386) >> > at >> > >> org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:323) >> > at >> > >> org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:143) >> > Caused by: org.apache.tez.dag.api.SessionNotRunning: TezSession has >> > already shutdown. Application application_1550371508120_0001 failed 2 >> > times due to AM Container for appattempt_1550371508120_0001_000002 >> > exited with exitCode: 127 >> > For more detailed output, check application tracking >> > page: >> > >> http://40a4dd0e8959:38843/cluster/app/application_1550371508120_0001Then, >> > click on links to logs of each attempt. >> > Diagnostics: Exception from container-launch. >> > Container id: container_1550371508120_0001_02_000001 >> > Exit code: 127 >> > Stack trace: ExitCodeException exitCode=127: >> > at org.apache.hadoop.util.Shell.runCommand(Shell.java:545) >> > at org.apache.hadoop.util.Shell.run(Shell.java:456) >> > at >> > >> org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:722) >> > at >> > >> org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:211) >> > at >> > >> org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302) >> > at >> > >> org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82) >> > at java.util.concurrent.FutureTask.run(FutureTask.java:266) >> > at >> > >> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) >> > at >> > >> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) >> > at java.lang.Thread.run(Thread.java:748) >> > >> > >> > Container exited with a non-zero exit code 127 >> > Failing this attempt. Failing the application. >> > at >> > org.apache.tez.client.TezClient.waitTillReady(TezClient.java:914) >> > at >> > org.apache.tez.client.TezClient.waitTillReady(TezClient.java:883) >> > at >> > >> org.apache.hadoop.hive.ql.exec.tez.TezSessionState.open(TezSessionState.java:205) >> > at >> > >> org.apache.hadoop.hive.ql.exec.tez.TezSessionState.open(TezSessionState.java:116) >> > at >> > >> org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:532) >> > ... 40 more >> > >> >