Unfortunately this sbt dependency is not working libraryDependencies += "org.apache.spark" %% "spark-core" % "1.5.1" % "provided" libraryDependencies += "org.apache.spark" %% "spark-sql" % "1.5.1" % "provided" libraryDependencies += "org.apache.spark" %% "spark-hive" % "1.5.1" % "provided" libraryDependencies += "junit" % "junit" % "4.12" libraryDependencies += "org.scala-sbt" % "test-interface" % "1.0" libraryDependencies += "org.apache.spark" %% "spark-streaming" % "1.6.1" % "provided" libraryDependencies += "org.apache.spark" %% "spark-streaming-kafka" % "1.6.1" libraryDependencies += "org.scalactic" %% "scalactic" % "2.2.6" *libraryDependencies += "org.scalatest" %% "scalatest" % "2.2.6" % "test"*
Getting error [info] Compiling 1 Scala source to /data6/hduser/scala/CEP_assembly/target/scala-2.10/classes... [error] /data6/hduser/scala/CEP_assembly/src/main/scala/myPackage/CEP_assemly.scala:32: object scalatest is not a member of package org [error] import org.scalatest.{BeforeAndAfter, BeforeAndAfterAll} [error] ^ Dr Mich Talebzadeh LinkedIn * https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw <https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>* http://talebzadehmich.wordpress.com On 21 April 2016 at 16:49, Mich Talebzadeh <mich.talebza...@gmail.com> wrote: > Thanks Ted. It was a typo in my alias and it is sorted now > > slong='rlwrap spark-shell --master spark://50.140.197.217:7077 --jars > /home/hduser/jars/ojdbc6.jar,/home/hduser/jars/jconn4.jar,/home/hduser/jars/junit-4.12.jar,/home/hduser/jars/spark-streaming-kafka-assembly_2.10-1.6.1.jar,/home/hduser/jars/scalatest_2.11-2.2.6.jar' > > > scala> import org.scalatest.{BeforeAndAfter, BeforeAndAfterAll} > import org.scalatest.{BeforeAndAfter, BeforeAndAfterAll} > > > > Dr Mich Talebzadeh > > > > LinkedIn * > https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw > <https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>* > > > > http://talebzadehmich.wordpress.com > > > > On 21 April 2016 at 16:44, Ted Yu <yuzhih...@gmail.com> wrote: > >> I tried on refreshed copy of master branch: >> >> $ bin/spark-shell --jars >> /home/hbase/.m2/repository/org/scalatest/scalatest_2.11/2.2.6/scalatest_2.11-2.2.6.jar >> ... >> scala> import org.scalatest.{BeforeAndAfter, BeforeAndAfterAll} >> import org.scalatest.{BeforeAndAfter, BeforeAndAfterAll} >> >> BTW I noticed an extra leading comma after '--jars' in your email. >> Not sure if that matters. >> >> On Thu, Apr 21, 2016 at 8:39 AM, Ted Yu <yuzhih...@gmail.com> wrote: >> >>> Mich: >>> >>> $ jar tvf >>> /home/hbase/.m2/repository/org/scalatest/scalatest_2.11/2.2.6/scalatest_2.11-2.2.6.jar >>> | grep BeforeAndAfter >>> 4257 Sat Dec 26 14:35:48 PST 2015 >>> org/scalatest/BeforeAndAfter$class.class >>> 2602 Sat Dec 26 14:35:48 PST 2015 org/scalatest/BeforeAndAfter.class >>> 1998 Sat Dec 26 14:35:48 PST 2015 >>> org/scalatest/BeforeAndAfterAll$$anonfun$run$1.class >>> >>> FYI >>> >>> On Thu, Apr 21, 2016 at 8:35 AM, Mich Talebzadeh < >>> mich.talebza...@gmail.com> wrote: >>> >>>> to Mario, Alonso, Luciano, user >>>> Hi, >>>> >>>> Following example in >>>> >>>> >>>> https://github.com/agsachin/spark/blob/CEP/external/kafka/src/test/scala/org/apache/spark/streaming/kafka/DirectKafkaStreamSuite.scala#L532 >>>> >>>> Does anyone know which jar file this belongs to? >>>> >>>> I use *scalatest_2.11-2.2.6.jar *in my spark-shell >>>> >>>> spark-shell --master spark://50.140.197.217:7077 --jars >>>> ,/home/hduser/jars/junit-4.12.jar,/home/hduser/jars/spark-streaming-kafka-assembly_2.10-1.6.1.jar, >>>> /*home/hduser/jars/scalatest_2.11-2.2.6.jar'* >>>> >>>> scala> import org.scalatest.{BeforeAndAfter, BeforeAndAfterAll} >>>> <console>:28: error: object scalatest is not a member of package org >>>> import org.scalatest.{BeforeAndAfter, BeforeAndAfterAll} >>>> >>>> Thanks >>>> >>>> Dr Mich Talebzadeh >>>> >>>> >>>> >>>> LinkedIn * >>>> https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw >>>> <https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>* >>>> >>>> >>>> >>>> http://talebzadehmich.wordpress.com >>>> >>>> >>>> >>> >>> >> >