[jira] [Commented] (HIVE-23631) Use the test target instead of install
[
https://issues.apache.org/jira/browse/HIVE-23631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17130909#comment-17130909
]
Jesus Camacho Rodriguez commented on HIVE-23631:
+1
> Use the test target instead of install
> --
>
> Key: HIVE-23631
> URL: https://issues.apache.org/jira/browse/HIVE-23631
> Project: Hive
> Issue Type: Sub-task
>Reporter: Zoltan Haindrich
>Assignee: Zoltan Haindrich
>Priority: Major
> Labels: pull-request-available
> Time Spent: 40m
> Remaining Estimate: 0h
>
> after a full install; there are some issues with:
> time mvn test -pl ql,itests/hive-unit -Dtest=TestJdbcGenericUDTFGetSplits
> {code}
> [INFO] Running org.apache.hive.jdbc.TestJdbcGenericUDTFGetSplits
> [ERROR] Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed:
> 15.317 s <<< FAILURE! - in org.apache.hive.jdbc.TestJdbcGenericUDTFGetSplits
> [ERROR] org.apache.hive.jdbc.TestJdbcGenericUDTFGetSplits Time elapsed:
> 15.316 s <<< ERROR!
> org.apache.hive.service.ServiceException:
> org.apache.hive.service.ServiceException: Unable to setup tez session pool
> at
> org.apache.hive.service.server.HiveServer2.start(HiveServer2.java:733)
> at org.apache.hive.jdbc.miniHS2.MiniHS2.start(MiniHS2.java:382)
> at
> org.apache.hive.jdbc.AbstractTestJdbcGenericUDTFGetSplits.beforeTest(AbstractTestJdbcGenericUDTFGetSplits.java:88)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:498)
> at
> org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47)
> at
> org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
> at
> org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44)
> at
> org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24)
> at
> org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
> at org.junit.runners.ParentRunner.run(ParentRunner.java:309)
> at
> org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:365)
> at
> org.apache.maven.surefire.junit4.JUnit4Provider.executeWithRerun(JUnit4Provider.java:273)
> at
> org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:238)
> at
> org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:159)
> at
> org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:383)
> at
> org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:344)
> at
> org.apache.maven.surefire.booter.ForkedBooter.execute(ForkedBooter.java:125)
> at
> org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:417)
> Caused by: org.apache.hive.service.ServiceException: Unable to setup tez
> session pool
> at
> org.apache.hive.service.server.HiveServer2.initAndStartTezSessionPoolManager(HiveServer2.java:832)
> at
> org.apache.hive.service.server.HiveServer2.startOrReconnectTezSessions(HiveServer2.java:807)
> at
> org.apache.hive.service.server.HiveServer2.start(HiveServer2.java:730)
> ... 20 more
> Caused by: java.io.FileNotFoundException: /home/dev/hive/ql/target/classes
> (Is a directory)
> at java.io.FileInputStream.open0(Native Method)
> at java.io.FileInputStream.open(FileInputStream.java:195)
> at java.io.FileInputStream.(FileInputStream.java:138)
> at
> org.apache.hadoop.fs.RawLocalFileSystem$LocalFSFileInputStream.(RawLocalFileSystem.java:110)
> at
> org.apache.hadoop.fs.RawLocalFileSystem.open(RawLocalFileSystem.java:212)
> at
> org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSInputChecker.(ChecksumFileSystem.java:147)
> at
> org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:347)
> at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:950)
> at
> org.apache.hadoop.hive.ql.exec.tez.TezSessionState.getSha(TezSessionState.java:863)
> at
> org.apache.hadoop.hive.ql.exec.tez.TezSessionState.createJarLocalResource(TezSessionState.java:809)
> at
> org.apache.hadoop.hive.ql.exec.tez.TezSessionState.openInternal(TezSessionState.java:288)
> at
> org.apache.hadoop.hive.ql.exec.tez.TezSessionPoolSession.openInternal(TezSessionPoolSession.java:124)
> at
> org.apache.hadoop.hive.ql.exec.tez.TezSessionState.open(TezSessionState.java:240)
> at
>
[jira] [Commented] (HIVE-23631) Use the test target instead of install
[
https://issues.apache.org/jira/browse/HIVE-23631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17130644#comment-17130644
]
Zoltan Haindrich commented on HIVE-23631:
-
[~jcamachorodriguez] could you please take a look?
> Use the test target instead of install
> --
>
> Key: HIVE-23631
> URL: https://issues.apache.org/jira/browse/HIVE-23631
> Project: Hive
> Issue Type: Sub-task
>Reporter: Zoltan Haindrich
>Assignee: Zoltan Haindrich
>Priority: Major
> Labels: pull-request-available
> Time Spent: 40m
> Remaining Estimate: 0h
>
> after a full install; there are some issues with:
> time mvn test -pl ql,itests/hive-unit -Dtest=TestJdbcGenericUDTFGetSplits
> {code}
> [INFO] Running org.apache.hive.jdbc.TestJdbcGenericUDTFGetSplits
> [ERROR] Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed:
> 15.317 s <<< FAILURE! - in org.apache.hive.jdbc.TestJdbcGenericUDTFGetSplits
> [ERROR] org.apache.hive.jdbc.TestJdbcGenericUDTFGetSplits Time elapsed:
> 15.316 s <<< ERROR!
> org.apache.hive.service.ServiceException:
> org.apache.hive.service.ServiceException: Unable to setup tez session pool
> at
> org.apache.hive.service.server.HiveServer2.start(HiveServer2.java:733)
> at org.apache.hive.jdbc.miniHS2.MiniHS2.start(MiniHS2.java:382)
> at
> org.apache.hive.jdbc.AbstractTestJdbcGenericUDTFGetSplits.beforeTest(AbstractTestJdbcGenericUDTFGetSplits.java:88)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:498)
> at
> org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47)
> at
> org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
> at
> org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44)
> at
> org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24)
> at
> org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
> at org.junit.runners.ParentRunner.run(ParentRunner.java:309)
> at
> org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:365)
> at
> org.apache.maven.surefire.junit4.JUnit4Provider.executeWithRerun(JUnit4Provider.java:273)
> at
> org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:238)
> at
> org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:159)
> at
> org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:383)
> at
> org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:344)
> at
> org.apache.maven.surefire.booter.ForkedBooter.execute(ForkedBooter.java:125)
> at
> org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:417)
> Caused by: org.apache.hive.service.ServiceException: Unable to setup tez
> session pool
> at
> org.apache.hive.service.server.HiveServer2.initAndStartTezSessionPoolManager(HiveServer2.java:832)
> at
> org.apache.hive.service.server.HiveServer2.startOrReconnectTezSessions(HiveServer2.java:807)
> at
> org.apache.hive.service.server.HiveServer2.start(HiveServer2.java:730)
> ... 20 more
> Caused by: java.io.FileNotFoundException: /home/dev/hive/ql/target/classes
> (Is a directory)
> at java.io.FileInputStream.open0(Native Method)
> at java.io.FileInputStream.open(FileInputStream.java:195)
> at java.io.FileInputStream.(FileInputStream.java:138)
> at
> org.apache.hadoop.fs.RawLocalFileSystem$LocalFSFileInputStream.(RawLocalFileSystem.java:110)
> at
> org.apache.hadoop.fs.RawLocalFileSystem.open(RawLocalFileSystem.java:212)
> at
> org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSInputChecker.(ChecksumFileSystem.java:147)
> at
> org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:347)
> at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:950)
> at
> org.apache.hadoop.hive.ql.exec.tez.TezSessionState.getSha(TezSessionState.java:863)
> at
> org.apache.hadoop.hive.ql.exec.tez.TezSessionState.createJarLocalResource(TezSessionState.java:809)
> at
> org.apache.hadoop.hive.ql.exec.tez.TezSessionState.openInternal(TezSessionState.java:288)
> at
> org.apache.hadoop.hive.ql.exec.tez.TezSessionPoolSession.openInternal(TezSessionPoolSession.java:124)
> at
> org.apache.hadoop.hive.ql.exec.tez.TezSessionState.open(TezSessionState.java:240)
> at
>
[jira] [Commented] (HIVE-23631) Use the test target instead of install
[
https://issues.apache.org/jira/browse/HIVE-23631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17128095#comment-17128095
]
Zoltan Haindrich commented on HIVE-23631:
-
seems like using the target org.apache.maven.plugins:maven-surefire-plugin:test
instead of test might work
employing this will reduce compile time on each branches a bit - but more
importantly; it will reduce the "noise" created by the shading plugin - which
is usually heavily noticeable
> Use the test target instead of install
> --
>
> Key: HIVE-23631
> URL: https://issues.apache.org/jira/browse/HIVE-23631
> Project: Hive
> Issue Type: Sub-task
>Reporter: Zoltan Haindrich
>Assignee: Zoltan Haindrich
>Priority: Major
>
> after a full install; there are some issues with:
> time mvn test -pl ql,itests/hive-unit -Dtest=TestJdbcGenericUDTFGetSplits
> {code}
> [INFO] Running org.apache.hive.jdbc.TestJdbcGenericUDTFGetSplits
> [ERROR] Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed:
> 15.317 s <<< FAILURE! - in org.apache.hive.jdbc.TestJdbcGenericUDTFGetSplits
> [ERROR] org.apache.hive.jdbc.TestJdbcGenericUDTFGetSplits Time elapsed:
> 15.316 s <<< ERROR!
> org.apache.hive.service.ServiceException:
> org.apache.hive.service.ServiceException: Unable to setup tez session pool
> at
> org.apache.hive.service.server.HiveServer2.start(HiveServer2.java:733)
> at org.apache.hive.jdbc.miniHS2.MiniHS2.start(MiniHS2.java:382)
> at
> org.apache.hive.jdbc.AbstractTestJdbcGenericUDTFGetSplits.beforeTest(AbstractTestJdbcGenericUDTFGetSplits.java:88)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:498)
> at
> org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47)
> at
> org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
> at
> org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44)
> at
> org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24)
> at
> org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
> at org.junit.runners.ParentRunner.run(ParentRunner.java:309)
> at
> org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:365)
> at
> org.apache.maven.surefire.junit4.JUnit4Provider.executeWithRerun(JUnit4Provider.java:273)
> at
> org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:238)
> at
> org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:159)
> at
> org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:383)
> at
> org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:344)
> at
> org.apache.maven.surefire.booter.ForkedBooter.execute(ForkedBooter.java:125)
> at
> org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:417)
> Caused by: org.apache.hive.service.ServiceException: Unable to setup tez
> session pool
> at
> org.apache.hive.service.server.HiveServer2.initAndStartTezSessionPoolManager(HiveServer2.java:832)
> at
> org.apache.hive.service.server.HiveServer2.startOrReconnectTezSessions(HiveServer2.java:807)
> at
> org.apache.hive.service.server.HiveServer2.start(HiveServer2.java:730)
> ... 20 more
> Caused by: java.io.FileNotFoundException: /home/dev/hive/ql/target/classes
> (Is a directory)
> at java.io.FileInputStream.open0(Native Method)
> at java.io.FileInputStream.open(FileInputStream.java:195)
> at java.io.FileInputStream.(FileInputStream.java:138)
> at
> org.apache.hadoop.fs.RawLocalFileSystem$LocalFSFileInputStream.(RawLocalFileSystem.java:110)
> at
> org.apache.hadoop.fs.RawLocalFileSystem.open(RawLocalFileSystem.java:212)
> at
> org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSInputChecker.(ChecksumFileSystem.java:147)
> at
> org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:347)
> at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:950)
> at
> org.apache.hadoop.hive.ql.exec.tez.TezSessionState.getSha(TezSessionState.java:863)
> at
> org.apache.hadoop.hive.ql.exec.tez.TezSessionState.createJarLocalResource(TezSessionState.java:809)
> at
> org.apache.hadoop.hive.ql.exec.tez.TezSessionState.openInternal(TezSessionState.java:288)
> at
>
