Kevin W Monroe created ZEPPELIN-2458: ----------------------------------------
Summary: tutorial requires sqlContext.implicits._? Key: ZEPPELIN-2458 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2458 Project: Zeppelin Issue Type: Bug Affects Versions: 0.7.0 Environment: Ubuntu 16.04 with zeppelin installed from Apache Bigtop repository. Reporter: Kevin W Monroe Priority: Minor I'm unable to run the Basic Features (Spark) notebook included in Zeppelin 0.7.0: {noformat} DEBUG [2017-04-26 16:07:34,967] ({Exec Stream Pumper} RemoteInterpreterManagedProcess.java[processLine]:189) - defined class Bank DEBUG [2017-04-26 16:07:35,312] ({Exec Stream Pumper} RemoteInterpreterManagedProcess.java[processLine]:189) - <console>:32: error: value toDF is not a member of org.apache.spark.rdd.RDD[Bank] DEBUG [2017-04-26 16:07:35,313] ({Exec Stream Pumper} RemoteInterpreterManagedProcess.java[processLine]:189) - possible cause: maybe a semicolon is missing before `value toDF'? DEBUG [2017-04-26 16:07:35,313] ({Exec Stream Pumper} RemoteInterpreterManagedProcess.java[processLine]:189) - ).toDF() DEBUG [2017-04-26 16:07:35,313] ({Exec Stream Pumper} RemoteInterpreterManagedProcess.java[processLine]:189) - ^ WARN [2017-04-26 16:07:35,359] ({pool-2-thread-1} NotebookServer.java[afterStatusChange]:2026) - Job 20150210-015259_1403135953 is finished, status: ERROR, exception: null, result: {noformat} This was mentioned way back in ZEPPELIN-90, but the resolution was to move to spark >= 1.3. I'm using Spark 2.1.0 (verfied with {{sc.version}} in a zeppelin paragraph). The spark interpreter master setting is {{local\[*]}} with spark.home set to {{/var/lib/spark}}, which is where spark debs are installed. I have the following package versions: {noformat} $ dpkg -l | grep -E 'spark|zeppelin' ii spark-core 2.1.0-1 all Lightning-Fast Cluster Computing ii spark-datanucleus 2.1.0-1 all DataNucleus libraries for Apache Spark ii spark-python 2.1.0-1 all Python client for Spark ii zeppelin 0.7.0-1 all Web-based notebook for data analysts {noformat} The workaround for me is to import the sqlcontext.implicits in the affected paragraph: {noformat} import sqlContext.implicits._ {noformat} -- This message was sent by Atlassian JIRA (v6.3.15#6346)