like war of attrition :) now I get with sbt
object SparkFunSuite is not a member of package org.apache.spark Dr Mich Talebzadeh LinkedIn * https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw <https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>* http://talebzadehmich.wordpress.com On 21 April 2016 at 17:22, Ted Yu <yuzhih...@gmail.com> wrote: > Have you tried the following ? > > libraryDependencies += "org.scalatest" %% "scalatest" % "2.2.6" > > On Thu, Apr 21, 2016 at 9:19 AM, Mich Talebzadeh < > mich.talebza...@gmail.com> wrote: > >> Unfortunately this sbt dependency is not working >> >> libraryDependencies += "org.apache.spark" %% "spark-core" % "1.5.1" % >> "provided" >> libraryDependencies += "org.apache.spark" %% "spark-sql" % "1.5.1" % >> "provided" >> libraryDependencies += "org.apache.spark" %% "spark-hive" % "1.5.1" % >> "provided" >> libraryDependencies += "junit" % "junit" % "4.12" >> libraryDependencies += "org.scala-sbt" % "test-interface" % "1.0" >> libraryDependencies += "org.apache.spark" %% "spark-streaming" % "1.6.1" >> % "provided" >> libraryDependencies += "org.apache.spark" %% "spark-streaming-kafka" % >> "1.6.1" >> libraryDependencies += "org.scalactic" %% "scalactic" % "2.2.6" >> *libraryDependencies += "org.scalatest" %% "scalatest" % "2.2.6" % "test"* >> >> Getting error >> >> [info] Compiling 1 Scala source to >> /data6/hduser/scala/CEP_assembly/target/scala-2.10/classes... >> [error] >> /data6/hduser/scala/CEP_assembly/src/main/scala/myPackage/CEP_assemly.scala:32: >> object scalatest is not a member of package org >> [error] import org.scalatest.{BeforeAndAfter, BeforeAndAfterAll} >> [error] ^ >> >> >> >> Dr Mich Talebzadeh >> >> >> >> LinkedIn * >> https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw >> <https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>* >> >> >> >> http://talebzadehmich.wordpress.com >> >> >> >> On 21 April 2016 at 16:49, Mich Talebzadeh <mich.talebza...@gmail.com> >> wrote: >> >>> Thanks Ted. It was a typo in my alias and it is sorted now >>> >>> slong='rlwrap spark-shell --master spark://50.140.197.217:7077 --jars >>> /home/hduser/jars/ojdbc6.jar,/home/hduser/jars/jconn4.jar,/home/hduser/jars/junit-4.12.jar,/home/hduser/jars/spark-streaming-kafka-assembly_2.10-1.6.1.jar,/home/hduser/jars/scalatest_2.11-2.2.6.jar' >>> >>> >>> scala> import org.scalatest.{BeforeAndAfter, BeforeAndAfterAll} >>> import org.scalatest.{BeforeAndAfter, BeforeAndAfterAll} >>> >>> >>> >>> Dr Mich Talebzadeh >>> >>> >>> >>> LinkedIn * >>> https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw >>> <https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>* >>> >>> >>> >>> http://talebzadehmich.wordpress.com >>> >>> >>> >>> On 21 April 2016 at 16:44, Ted Yu <yuzhih...@gmail.com> wrote: >>> >>>> I tried on refreshed copy of master branch: >>>> >>>> $ bin/spark-shell --jars >>>> /home/hbase/.m2/repository/org/scalatest/scalatest_2.11/2.2.6/scalatest_2.11-2.2.6.jar >>>> ... >>>> scala> import org.scalatest.{BeforeAndAfter, BeforeAndAfterAll} >>>> import org.scalatest.{BeforeAndAfter, BeforeAndAfterAll} >>>> >>>> BTW I noticed an extra leading comma after '--jars' in your email. >>>> Not sure if that matters. >>>> >>>> On Thu, Apr 21, 2016 at 8:39 AM, Ted Yu <yuzhih...@gmail.com> wrote: >>>> >>>>> Mich: >>>>> >>>>> $ jar tvf >>>>> /home/hbase/.m2/repository/org/scalatest/scalatest_2.11/2.2.6/scalatest_2.11-2.2.6.jar >>>>> | grep BeforeAndAfter >>>>> 4257 Sat Dec 26 14:35:48 PST 2015 >>>>> org/scalatest/BeforeAndAfter$class.class >>>>> 2602 Sat Dec 26 14:35:48 PST 2015 org/scalatest/BeforeAndAfter.class >>>>> 1998 Sat Dec 26 14:35:48 PST 2015 >>>>> org/scalatest/BeforeAndAfterAll$$anonfun$run$1.class >>>>> >>>>> FYI >>>>> >>>>> On Thu, Apr 21, 2016 at 8:35 AM, Mich Talebzadeh < >>>>> mich.talebza...@gmail.com> wrote: >>>>> >>>>>> to Mario, Alonso, Luciano, user >>>>>> Hi, >>>>>> >>>>>> Following example in >>>>>> >>>>>> >>>>>> https://github.com/agsachin/spark/blob/CEP/external/kafka/src/test/scala/org/apache/spark/streaming/kafka/DirectKafkaStreamSuite.scala#L532 >>>>>> >>>>>> Does anyone know which jar file this belongs to? >>>>>> >>>>>> I use *scalatest_2.11-2.2.6.jar *in my spark-shell >>>>>> >>>>>> spark-shell --master spark://50.140.197.217:7077 --jars >>>>>> ,/home/hduser/jars/junit-4.12.jar,/home/hduser/jars/spark-streaming-kafka-assembly_2.10-1.6.1.jar, >>>>>> /*home/hduser/jars/scalatest_2.11-2.2.6.jar'* >>>>>> >>>>>> scala> import org.scalatest.{BeforeAndAfter, BeforeAndAfterAll} >>>>>> <console>:28: error: object scalatest is not a member of package org >>>>>> import org.scalatest.{BeforeAndAfter, BeforeAndAfterAll} >>>>>> >>>>>> Thanks >>>>>> >>>>>> Dr Mich Talebzadeh >>>>>> >>>>>> >>>>>> >>>>>> LinkedIn * >>>>>> https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw >>>>>> <https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>* >>>>>> >>>>>> >>>>>> >>>>>> http://talebzadehmich.wordpress.com >>>>>> >>>>>> >>>>>> >>>>> >>>>> >>>> >>> >> >
