Re: creating database issue

2021-12-07 Thread bitfox
And, I can't start spark-sql shell, the error as below. Does this mean I need to install Hive on local machine? Caused by: java.sql.SQLException: Failed to start database 'metastore_db' with class loader jdk.internal.loader.ClassLoaders$AppClassLoader@5ffd2b27, see the next exception for

Re: creating database issue

2021-12-07 Thread bitfox
Hello This is just a standalone deployment for testing purpose. The version: Spark 3.2.0 (git revision 5d45a415f3) built for Hadoop 3.3.1 Build flags: -B -Pmesos -Pyarn -Pkubernetes -Psparkr -Pscala-2.12 -Phadoop-3.2 -Phive -Phive-thriftserver I just started one master and one worker for the

Re: creating database issue

2021-12-07 Thread Qian Sun
Hi, It seems to be a hms question. Would u like to provide the information about spark version, hive version and spark application configuration? Best > 2021年12月8日 上午9:04,bitfox 写道: > > sorry I am newbie to spark. > > When I created a database in pyspark shell following the book content

creating database issue

2021-12-07 Thread bitfox
sorry I am newbie to spark. When I created a database in pyspark shell following the book content of learning spark 2.0, it gets: >>> spark.sql("CREATE DATABASE learn_spark_db") 21/12/08 09:01:34 WARN HiveConf: HiveConf of name hive.stats.jdbc.timeout does not exist 21/12/08 09:01:34 WARN