Sorry just saw your message Yuming. I built the dist following this doc: https://cwiki.apache.org/confluence/display/Hive/HowToRelease#HowToRelease-HiveRelease, with command:
mvn install -Pdist -DskipTests -Dmaven.javadoc.skip=true -DcreateChecksum=true and when I do the same for Hive 2.3.7, the result jars match mostly. However the downloaded 2.3.7 distribution from https://downloads.apache.org/hive/hive-2.3.7/ seems to be missing jars such as spark/scala (which I assume is from Hive on Spark). I also checked Hive 2.3.6 and it doesn't have those either. Anyone knows whether the packaging process has changed from the above doc? On Wed, Dec 16, 2020 at 4:26 PM Wang, Yuming <yumw...@ebay.com.invalid> wrote: > > Hive 2.3.8 has more jars than Hive 2.3.7. Is this we expected? > > diff --git a/2.3.7.jars b/2.3.8.jars > index d40ebb932b..d18191bc98 100644 > --- a/2.3.7.jars > +++ b/2.3.8.jars > @@ -22,17 +22,17 @@ asm-commons-3.1.jar > asm-tree-3.1.jar > avatica-1.8.0.jar > avatica-metrics-1.8.0.jar > -avro-1.7.7.jar > +avro-1.8.2.jar > +avro-ipc-1.8.2.jar > +avro-mapred-1.8.2-hadoop2.jar > bonecp-0.8.0.RELEASE.jar > bytebuffer-collections-0.2.5.jar > -calcite-core-1.10.0.jar > -calcite-druid-1.10.0.jar > -calcite-linq4j-1.10.0.jar > +chill_2.11-0.8.0.jar > +chill-java-0.8.0.jar > classmate-1.0.0.jar > commons-cli-1.2.jar > commons-codec-1.4.jar > commons-collections-3.2.2.jar > -commons-compiler-2.7.6.jar > commons-compress-1.9.jar > commons-dbcp-1.4.jar > commons-dbcp2-2.0.1.jar > @@ -67,7 +67,6 @@ druid-console-0.0.2.jar > druid-hdfs-storage-0.9.2.jar > druid-processing-0.9.2.jar > druid-server-0.9.2.jar > -eigenbase-properties-1.1.5.jar > emitter-0.3.6.jar > extendedset-1.3.10.jar > findbugs-annotations-1.3.9-1.jar > @@ -94,36 +93,36 @@ hbase-protocol-1.1.1.jar > hbase-server-1.1.1.jar > hibernate-validator-5.1.3.Final.jar > HikariCP-2.5.1.jar > -hive-accumulo-handler-2.3.7.jar > -hive-beeline-2.3.7.jar > -hive-cli-2.3.7.jar > -hive-common-2.3.7.jar > -hive-contrib-2.3.7.jar > -hive-druid-handler-2.3.7.jar > -hive-exec-2.3.7.jar > -hive-hbase-handler-2.3.7.jar > -hive-hcatalog-core-2.3.7.jar > -hive-hcatalog-server-extensions-2.3.7.jar > -hive-hplsql-2.3.7.jar > -hive-jdbc-2.3.7.jar > -hive-jdbc-handler-2.3.7.jar > -hive-llap-client-2.3.7.jar > -hive-llap-common-2.3.7.jar > -hive-llap-common-2.3.7-tests.jar > -hive-llap-ext-client-2.3.7.jar > -hive-llap-server-2.3.7.jar > -hive-llap-tez-2.3.7.jar > -hive-metastore-2.3.7.jar > -hive-serde-2.3.7.jar > -hive-service-2.3.7.jar > -hive-service-rpc-2.3.7.jar > -hive-shims-0.23-2.3.7.jar > -hive-shims-2.3.7.jar > -hive-shims-common-2.3.7.jar > -hive-shims-scheduler-2.3.7.jar > +hive-accumulo-handler-2.3.8.jar > +hive-beeline-2.3.8.jar > +hive-cli-2.3.8.jar > +hive-common-2.3.8.jar > +hive-contrib-2.3.8.jar > +hive-druid-handler-2.3.8.jar > +hive-exec-2.3.8.jar > +hive-hbase-handler-2.3.8.jar > +hive-hcatalog-core-2.3.8.jar > +hive-hcatalog-server-extensions-2.3.8.jar > +hive-hplsql-2.3.8.jar > +hive-jdbc-2.3.8.jar > +hive-jdbc-handler-2.3.8.jar > +hive-llap-client-2.3.8.jar > +hive-llap-common-2.3.8.jar > +hive-llap-common-2.3.8-tests.jar > +hive-llap-ext-client-2.3.8.jar > +hive-llap-server-2.3.8.jar > +hive-llap-tez-2.3.8.jar > +hive-metastore-2.3.8.jar > +hive-serde-2.3.8.jar > +hive-service-2.3.8.jar > +hive-service-rpc-2.3.8.jar > +hive-shims-0.23-2.3.8.jar > +hive-shims-2.3.8.jar > +hive-shims-common-2.3.8.jar > +hive-shims-scheduler-2.3.8.jar > hive-storage-api-2.4.0.jar > -hive-testutils-2.3.7.jar > -hive-vector-code-gen-2.3.7.jar > +hive-testutils-2.3.8.jar > +hive-vector-code-gen-2.3.8.jar > htrace-core-3.1.0-incubating.jar > http-client-1.0.4.jar > httpclient-4.4.jar > @@ -133,6 +132,7 @@ irc-api-1.0-0014.jar > ivy-2.4.0.jar > jackson-annotations-2.6.0.jar > jackson-core-2.6.5.jar > +jackson-core-asl-1.9.13.jar > jackson-databind-2.6.5.jar > jackson-dataformat-smile-2.4.6.jar > jackson-datatype-guava-2.4.6.jar > @@ -141,12 +141,15 @@ jackson-jaxrs-1.9.13.jar > jackson-jaxrs-base-2.4.6.jar > jackson-jaxrs-json-provider-2.4.6.jar > jackson-jaxrs-smile-provider-2.4.6.jar > +jackson-mapper-asl-1.9.13.jar > jackson-module-jaxb-annotations-2.4.6.jar > +jackson-module-paranamer-2.6.5.jar > +jackson-module-scala_2.11-2.6.5.jar > jackson-xc-1.9.13.jar > jamon-runtime-2.3.1.jar > -janino-2.7.6.jar > jasper-compiler-5.5.23.jar > jasper-runtime-5.5.23.jar > +JavaEWAH-0.3.2.jar > java-util-0.27.10.jar > javax.el-3.0.0.jar > javax.el-api-3.0.0.jar > @@ -180,10 +183,14 @@ jetty-util-6.1.26.jar > jetty-util-9.2.5.v20141112.jar > jline-2.12.jar > joda-time-2.8.1.jar > +jodd-core-3.5.2.jar > jol-core-0.2.jar > joni-2.1.2.jar > jpam-1.1.jar > json-1.8.jar > +json4s-ast_2.11-3.2.11.jar > +json4s-core_2.11-3.2.11.jar > +json4s-jackson_2.11-3.2.11.jar > json-path-2.1.0.jar > jsp-2.1-6.1.14.jar > jsp-api-2.0.jar > @@ -191,6 +198,7 @@ jsp-api-2.1-6.1.14.jar > jsp-api-2.1.jar > jsr305-3.0.0.jar > jta-1.1.jar > +kryo-shaded-3.0.3.jar > libfb303-0.9.3.jar > libthrift-0.9.3.jar > log4j-1.2-api-2.6.2.jar > @@ -212,20 +220,24 @@ maven-scm-provider-svnexe-1.4.jar > maven-settings-3.1.1.jar > maven-settings-builder-3.1.1.jar > maxminddb-0.2.0.jar > +mesos-0.21.1-shaded-protobuf.jar > metrics-core-2.2.0.jar > metrics-core-3.1.0.jar > +metrics-graphite-3.1.2.jar > metrics-json-3.1.0.jar > metrics-jvm-3.1.0.jar > +minlog-1.3.0.jar > mysql-metadata-storage-0.9.2.jar > netty-3.6.2.Final.jar > netty-all-4.0.52.Final.jar > +objenesis-2.1.jar > okhttp-1.0.2.jar > opencsv-2.3.jar > orc-core-1.3.4.jar > +orc-tools-1.3.4.jar > org.abego.treelayout.core-1.0.1.jar > -paranamer-2.3.jar > +paranamer-2.7.jar > parquet-hadoop-bundle-1.8.1.jar > -pentaho-aggdesigner-algorithm-5.1.5-jhyde.jar > php > plexus-interpolation-1.19.jar > plexus-utils-3.0.15.jar > @@ -233,23 +245,43 @@ postgresql-9.4.1208.jre7.jar > postgresql-metadata-storage-0.9.2.jar > protobuf-java-2.5.0.jar > py > +py4j-0.10.1.jar > +pyrolite-4.9.jar > regexp-1.3.jar > rhino-1.7R5.jar > -RoaringBitmap-0.5.18.jar > +RoaringBitmap-0.5.11.jar > +scala-compiler-2.11.0.jar > +scala-library-2.11.8.jar > +scalap-2.11.0.jar > +scala-parser-combinators_2.11-1.0.1.jar > +scala-reflect-2.11.7.jar > +scalatest_2.11-2.2.6.jar > +scala-xml_2.11-1.0.2.jar > server-metrics-0.2.8.jar > servlet-api-2.4.jar > servlet-api-2.5-6.1.14.jar > slice-0.29.jar > slider-core-0.90.2-incubating.jar > -snappy-java-1.0.5.jar > +snappy-java-1.1.1.3.jar > +spark-client-2.3.8.jar > +spark-core_2.11-2.0.0.jar > +spark-launcher_2.11-2.0.0.jar > +spark-network-common_2.11-2.0.0.jar > +spark-network-shuffle_2.11-2.0.0.jar > +spark-tags_2.11-2.0.0.jar > +spark-unsafe_2.11-2.0.0.jar > spymemcached-2.11.7.jar > ST4-4.0.4.jar > stax-api-1.0.1.jar > +stream-2.7.0.jar > super-csv-2.2.0.jar > tempus-fugit-1.1.jar > tesla-aether-0.0.5.jar > transaction-api-1.1.jar > +unused-1.0.0.jar > validation-api-1.1.0.Final.jar > velocity-1.5.jar > wagon-provider-api-2.4.jar > +xbean-asm5-shaded-4.4.jar > +xz-1.5.jar > zookeeper-3.4.6.jar > > > > > On 2020/12/17, 08:00, "Chao Sun" <sunc...@apache.org> wrote: > > External Email > > Sorry I found another issue while testing the RC. I'll cancel this and > start another RC shortly. > > Best, > Chao > > On Wed, Dec 16, 2020 at 12:42 AM Dongjoon Hyun <dongj...@apache.org> > wrote: > > > +1 > > > > Thank you so much, Chao. > > > > Bests, > > Dongjoon. > > > > On 2020/12/14 19:02:10, Chao Sun <sunc...@apache.org> wrote: > > > Apache Hive 2.3.8 Release Candidate 2 is available here: > > > > https://nam01.safelinks.protection.outlook.com/?url=https:%2F%2Fpeople.apache.org%2F~sunchao%2Fapache-hive-2.3.8-rc-2%2F&data=04%7C01%7Cyumwang%40ebay.com%7Cea0e0f9777524b0123ef08d8a21ecdd3%7C46326bff992841a0baca17c16c94ea99%7C0%7C0%7C637437600478119770%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=dGshMC5oPWV84WkP7Udbq6ihSM9spDaT%2BaKprz%2FdeXI%3D&reserved=0 > > > Maven artifacts are available here: > > > > https://nam01.safelinks.protection.outlook.com/?url=https%3A%2F%2Frepository.apache.org%2Fcontent%2Frepositories%2Forgapachehive-1104&data=04%7C01%7Cyumwang%40ebay.com%7Cea0e0f9777524b0123ef08d8a21ecdd3%7C46326bff992841a0baca17c16c94ea99%7C0%7C0%7C637437600478119770%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=TeU%2F60swRDjXgt2UvWs1QIMXT6wWZc9G%2FtAgw3%2BuHJw%3D&reserved=0 > > > The tag release-2.3.8-rc2 has been applied to the source for this > > > release in github, you can see it at > > > > https://nam01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fapache%2Fhive%2Ftree%2Frelease-2.3.8-rc2&data=04%7C01%7Cyumwang%40ebay.com%7Cea0e0f9777524b0123ef08d8a21ecdd3%7C46326bff992841a0baca17c16c94ea99%7C0%7C0%7C637437600478119770%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=O3tLtipgAqRsz44ZyMdzfjaHqTY21C3QzLNaqqeSkk8%3D&reserved=0 > > > Voting will conclude in 72 hours (or whenever I scrounge together > enough > > > votes). > > > > > > Hive PMC Members: Please test and vote. > > > > > > Thanks. > > > > > > >