Re: Please assist: Spark 1.5.2 / cannot find StateSpec / State

2016-04-13 Thread Matthias Niehoff
The StateSpec and the mapWithState method is only available in Spark 1.6.x

2016-04-13 11:34 GMT+02:00 Marco Mistroni :

> hi all
>  i am trying to replicate the Streaming Wordcount example described here
>
>
> https://github.com/apache/spark/blob/master/examples/src/main/scala/org/apache/spark/examples/streaming/StatefulNetworkWordCount.scala
>
> in my build,sbt i have the following dependencies
>
> .
> libraryDependencies += "org.apache.spark" %% "spark-core"   % "1.5.2" %
> "provided"
> libraryDependencies += "org.apache.spark" %% "spark-streaming"   % "1.5.2"
> % "provided"
> libraryDependencies += "org.apache.spark" %% "spark-mllib"   % "1.5.2"  %
> "provided"
> libraryDependencies += "org.apache.spark" %% "spark-streaming-flume"   %
> "1.3.0"  % "provided"
> ...
> But compilations fail mentioning that class StateSpec and State are not
> found
>
> Could pls someone point me to the right packages to refer if i want to use
> StateSpec?
>
> kind regards
>  marco
>
>
>


-- 
Matthias Niehoff | IT-Consultant | Agile Software Factory  | Consulting
codecentric AG | Zeppelinstr 2 | 76185 Karlsruhe | Deutschland
tel: +49 (0) 721.9595-681 | fax: +49 (0) 721.9595-666 | mobil: +49 (0)
172.1702676
www.codecentric.de | blog.codecentric.de | www.meettheexperts.de |
www.more4fi.de

Sitz der Gesellschaft: Solingen | HRB 25917| Amtsgericht Wuppertal
Vorstand: Michael Hochgürtel . Mirko Novakovic . Rainer Vehns
Aufsichtsrat: Patric Fedlmeier (Vorsitzender) . Klaus Jäger . Jürgen Schütz

Diese E-Mail einschließlich evtl. beigefügter Dateien enthält vertrauliche
und/oder rechtlich geschützte Informationen. Wenn Sie nicht der richtige
Adressat sind oder diese E-Mail irrtümlich erhalten haben, informieren Sie
bitte sofort den Absender und löschen Sie diese E-Mail und evtl.
beigefügter Dateien umgehend. Das unerlaubte Kopieren, Nutzen oder Öffnen
evtl. beigefügter Dateien sowie die unbefugte Weitergabe dieser E-Mail ist
nicht gestattet


Please assist: Spark 1.5.2 / cannot find StateSpec / State

2016-04-13 Thread Marco Mistroni
hi all
 i am trying to replicate the Streaming Wordcount example described here

https://github.com/apache/spark/blob/master/examples/src/main/scala/org/apache/spark/examples/streaming/StatefulNetworkWordCount.scala

in my build,sbt i have the following dependencies

.
libraryDependencies += "org.apache.spark" %% "spark-core"   % "1.5.2" %
"provided"
libraryDependencies += "org.apache.spark" %% "spark-streaming"   % "1.5.2"
% "provided"
libraryDependencies += "org.apache.spark" %% "spark-mllib"   % "1.5.2"  %
"provided"
libraryDependencies += "org.apache.spark" %% "spark-streaming-flume"   %
"1.3.0"  % "provided"
...
But compilations fail mentioning that class StateSpec and State are not
found

Could pls someone point me to the right packages to refer if i want to use
StateSpec?

kind regards
 marco