sandeep-katta commented on a change in pull request #25431: [SPARK-28711][DOCS]
Update migration guide to add note about Hive upgrade
URL: https://github.com/apache/spark/pull/25431#discussion_r313702468
##########
File path: docs/sql-migration-guide-upgrade.md
##########
@@ -23,6 +23,9 @@ license: |
{:toc}
## Upgrading From Spark SQL 2.4 to 3.0
+ - Since Spark 3.0, hive is upgraded to 2.3.x, so it is required to update
the Hive
Review comment:
configure the metastoredb in the hive-site.xml as below
<property>
<name>javax.jdo.option.ConnectionURL</name>
<value>jdbc:mysql://vm1:3306/**sparksql**?characterEncoding=UTF-8</value>
</property>
under **sparksql** database there will be one table by name VERSION with the
below values
mysql> select * from VERSION;
+--------+----------------+--------------------------------------+
| VER_ID | SCHEMA_VERSION | VERSION_COMMENT |
+--------+----------------+--------------------------------------+
| 1 | **1.3.0** | Set by MetaStore
root@127.0.0.1 |
+--------+----------------+--------------------------------------+
1 row in set (0.00 sec)
if you upgrade the spark to 3.0 and restart thrift server it will not start.
You need to update SCHEMA_VERSION to at least **2.3.0**
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
