[
https://issues.apache.org/jira/browse/HIVE-28445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17875085#comment-17875085
]
Stamatis Zampetakis commented on HIVE-28445:
--------------------------------------------
The Hive JDBC jar has way more things than necessary. Adding more things inside
the shaded artifact is not the right approach. Optional or complementary
features should be pluggable and not require entire libraries to be packaged in
the same jar. From my perspective the ideal thing would be to not have
dependencies to zookeeper (or having them only as optional).
> Uber JAR of HiveServer2 JDBC Driver 4.1.0-SNAPSHOT is incompatible with
> `org.apache.zookeeper.zookeeper:3.9.2`
> --------------------------------------------------------------------------------------------------------------
>
> Key: HIVE-28445
> URL: https://issues.apache.org/jira/browse/HIVE-28445
> Project: Hive
> Issue Type: Bug
> Reporter: Qiheng He
> Priority: Major
>
> - Uber JAR of HiveServer2 JDBC Driver 4.1.0-SNAPSHOT is incompatible with
> `org.apache.zookeeper.zookeeper:3.9.2`. This is one of the findings from
> https://github.com/apache/shardingsphere/pull/31526 .
> - Just a simple compile.
> {code:bash}
> sdk install java 8.0.422-tem
> sdk use java 8.0.422-tem
> sdk install maven
> git clone g...@github.com:apache/hive.git
> cd ./hive/
> git reset --hard b09d76e68bfba6be19733d864b3207f95265d11f
> mvn clean install -DskipTests -T1C
> mvn clean package -pl packaging -DskipTests -Pdocker
> cd ../
> {code}
> - Introduce at will.
> {code:xml}
> <dependency>
> <groupId>org.apache.hive</groupId>
> <artifactId>hive-jdbc</artifactId>
> <version>4.1.0-SNAPSHOT</version>
> <classifier>standalone</classifier>
> </dependency>
> <dependency>
> <groupId>org.apache.zookeeper</groupId>
> <artifactId>zookeeper</artifactId>
> <version>3.9.2</version>
> </dependency>
> <dependency>
> <groupId>org.apache.curator</groupId>
> <artifactId>curator-test</artifactId>
> <version>5.7.0</version>
> <scope>test</scope>
> </dependency>
> <dependency>
> <groupId>org.junit.jupiter</groupId>
> <artifactId>junit-jupiter</artifactId>
> <version>5.10.3</version>
> <scope>test</scope>
> </dependency>
> <dependency>
> <groupId>org.awaitility</groupId>
> <artifactId>awaitility</artifactId>
> <version>4.2.0</version>
> <scope>test</scope>
> </dependency>
> {code}
> - Start a Zookeeper Server in the unit test.
> {code:java}
> import org.apache.curator.CuratorZookeeperClient;
> import org.apache.curator.retry.ExponentialBackoffRetry;
> import org.apache.curator.test.TestingServer;
> import org.awaitility.Awaitility;
> import org.junit.jupiter.api.Test;
> import java.time.Duration;
> public class ZookeeperTest {
> @Test
> void testZookeeper() throws Exception {
> TestingServer testingServer = new TestingServer();
> try (
> CuratorZookeeperClient client = new
> CuratorZookeeperClient(testingServer.getConnectString(),
> 60 * 1000, 500, null,
> new ExponentialBackoffRetry(500, 3, 500 * 3))) {
> client.start();
> Awaitility.await().atMost(Duration.ofMillis(500 *
> 60)).ignoreExceptions().until(client::isConnected);
> }
> }
> }
> {code}
> - The following Error Log is obtained.
> {code:bash}
> [ERROR] 2024-08-14 13:35:55.349 [SyncThread:0]
> o.a.z.server.ZooKeeperCriticalThread - Severe unrecoverable error, from
> thread : SyncThread:0
> java.lang.NoSuchMethodError: 'long
> org.apache.jute.OutputArchive.getDataSize()'
> at
> org.apache.zookeeper.server.persistence.FileTxnLog.append(FileTxnLog.java:291)
> at
> org.apache.zookeeper.server.persistence.FileTxnSnapLog.append(FileTxnSnapLog.java:592)
> at org.apache.zookeeper.server.ZKDatabase.append(ZKDatabase.java:672)
> at
> org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:181)
> [ERROR] 2024-08-14 13:35:55.373 [zkservermainrunner]
> o.a.zookeeper.server.ZooKeeperServer - Error updating DB
> java.io.EOFException: null
> at java.base/java.io.DataInputStream.readFully(DataInputStream.java:210)
> at java.base/java.io.DataInputStream.readInt(DataInputStream.java:385)
> at
> org.apache.jute.BinaryInputArchive.readInt(BinaryInputArchive.java:96)
> at
> org.apache.zookeeper.server.persistence.FileHeader.deserialize(FileHeader.java:67)
> at
> org.apache.zookeeper.server.persistence.FileTxnLog$FileTxnIterator.inStreamCreated(FileTxnLog.java:725)
> at
> org.apache.zookeeper.server.persistence.FileTxnLog$FileTxnIterator.createInputArchive(FileTxnLog.java:743)
> at
> org.apache.zookeeper.server.persistence.FileTxnLog$FileTxnIterator.goToNextLog(FileTxnLog.java:711)
> at
> org.apache.zookeeper.server.persistence.FileTxnLog$FileTxnIterator.init(FileTxnLog.java:687)
> at
> org.apache.zookeeper.server.persistence.FileTxnLog$FileTxnIterator.<init>(FileTxnLog.java:646)
> at
> org.apache.zookeeper.server.persistence.FileTxnLog.read(FileTxnLog.java:466)
> at
> org.apache.zookeeper.server.persistence.FileTxnLog.read(FileTxnLog.java:453)
> at
> org.apache.zookeeper.server.persistence.FileTxnSnapLog.fastForwardFromEdits(FileTxnSnapLog.java:330)
> at
> org.apache.zookeeper.server.ZKDatabase.fastForwardDataBase(ZKDatabase.java:302)
> at
> org.apache.zookeeper.server.ZooKeeperServer.shutdown(ZooKeeperServer.java:980)
> at
> org.apache.zookeeper.server.ZooKeeperServer.shutdown(ZooKeeperServer.java:928)
> at
> org.apache.zookeeper.server.NIOServerCnxnFactory.shutdown(NIOServerCnxnFactory.java:912)
> at
> org.apache.zookeeper.server.ZooKeeperServerMain.shutdown(ZooKeeperServerMain.java:223)
> at
> org.apache.zookeeper.server.ZooKeeperServerMain.runFromConfig(ZooKeeperServerMain.java:187)
> at
> org.apache.zookeeper.server.embedded.ZooKeeperServerEmbeddedImpl$4.run(ZooKeeperServerEmbeddedImpl.java:167)
> {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
