Having moved to Spark 1.6.1, I have noticed thar whenerver I start a spark-sql or shell. a dervy.log file is created in the directory!
cat derby.log ---------------------------------------------------------------- Sat Mar 26 11:18:55 GMT 2016: Booting Derby version The Apache Software Foundation - Apache Derby - 10.10.1.1 - (1458268): instance a816c00e-0153-b2a5-f8b1-000034f573f0 on database directory /work/tmp/spark-a978fb19-30fd-4ba0-859b-85ac2227ca84/metastore with class loader sun.misc.Launcher$AppClassLoader@1e05b891 Loaded from file:/usr/lib/spark-1.6.1-bin-hadoop2.6/lib/spark-assembly-1.6.1-hadoop2.6.0.jar java.vendor=Oracle Corporation java.runtime.version=1.7.0_25-b15 user.dir=/home/hduser/dba/bin os.name=Linux os.arch=amd64 os.version=2.6.18-92.el5xen derby.system.home=null Database Class Loader started - derby.database.classpath='' The thing is that I use Hive databases here but for one reason or other startup creates this log file. Can I turn it off? Is this new to 1.6.1? Thanks Dr Mich Talebzadeh LinkedIn * https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw <https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>* http://talebzadehmich.wordpress.com