Re: Which jar file has import org.apache.spark.internal.Logging

I would suggest reading the documentation first. http://spark.apache.org/docs/latest/api/scala/index.html#org.apache.spark.streaming.kafka.OffsetRange$ The OffsetRange class is not private. The instance constructor is private. You obtain instances by using the apply method on the companion

Re: Which jar file has import org.apache.spark.internal.Logging

So is there anyway of creating an rdd without using offsetRanges? Sorry for lack of clarity here val rdd = KafkaUtils.createRDD[String, String, StringDecoder, StringDecoder](sc, kafkaParams, offsetRanges) Dr Mich Talebzadeh LinkedIn *

Re: Which jar file has import org.apache.spark.internal.Logging

So there is really no point in using it :( Dr Mich Talebzadeh LinkedIn * https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw * http://talebzadehmich.wordpress.com On 23 April

Re: Which jar file has import org.apache.spark.internal.Logging

The class is private : final class OffsetRange private( On Fri, Apr 22, 2016 at 4:08 PM, Mich Talebzadeh wrote: > Ok I decided to forgo that approach and use an existing program of mine > with slight modification. The code is this > > import

Re: Which jar file has import org.apache.spark.internal.Logging

Ok I decided to forgo that approach and use an existing program of mine with slight modification. The code is this import org.apache.spark.SparkContext import org.apache.spark.SparkConf import org.apache.spark.sql.Row import org.apache.spark.sql.hive.HiveContext import

Re: Which jar file has import org.apache.spark.internal.Logging

On Fri, Apr 22, 2016 at 10:38 AM, Mich Talebzadeh wrote: > I am trying to test Spark with CEP and I have been shown a sample here >

Re: Which jar file has import org.apache.spark.internal.Logging

being that they're >> "private[spark]" and even if they're available, the compiler won't let >> you. >> >> On Fri, Apr 22, 2016 at 12:21 AM, Mich Talebzadeh >> <mich.talebza...@gmail.com> wrote: >> > >> > Hi, >> > >> >

Re: Which jar file has import org.apache.spark.internal.Logging

>= ew.prev.asInstanceOf[Tick].price } def drop(in: Tick, ew: WindowState): Boolean = { in.price >= ew.first.asInstanceOf[Tick].price && in.price < ew.prev.asInstanceOf[Tick].price } def deep(in: Tick, ew: WindowState): Boolean = { in.price <

Re: Which jar file has import org.apache.spark.internal.Logging

On Fri, Apr 22, 2016 at 12:21 AM, Mich Talebzadeh > <mich.talebza...@gmail.com> wrote: > > > > Hi, > > > > Anyone know which jar file has import org.apache.spark.internal.Logging? > > > > I tried spark-core_2.10-1.5.1.jar > > > > but does no

Re: Which jar file has import org.apache.spark.internal.Logging

them. First reason being that they're "private[spark]" and even if they're available, the compiler won't let you. On Fri, Apr 22, 2016 at 12:21 AM, Mich Talebzadeh <mich.talebza...@gmail.com> wrote: > > Hi, > > Anyone know which jar file has import org.apache.spark.interna

Re: Which jar file has import org.apache.spark.internal.Logging

^ >> [error] >> /data6/hduser/scala/CEP_assembly/src/main/scala/myPackage/CEP_assemly.scala:663: >> value patternMatchByWindow is not a member of >> org.apache.spark.streaming.dstream.DStream[(Long, Tick)] >> [error] val match

Re: Which jar file has import org.apache.spark.internal.Logging

g.apache.spark.streaming.dstream.DStream[(Long, Tick)] > [error] val matches = kvTicks.patternMatchByWindow("rise drop [rise ]+ > deep".r, > [error] ^ > [error] 22 errors found > [error] (compile:compileIncremental) Compilation failed >

Re: Which jar file has import org.apache.spark.internal.Logging

file/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw <https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>* http://talebzadehmich.wordpress.com On 22 April 2016 at 14:53, Ted Yu <yuzhih...@gmail.com> wrote: > Normally Logging would be

Re: Which jar file has import org.apache.spark.internal.Logging

ing In 1.6.x release, Logging was at org.apache.spark.Logging FYI On Fri, Apr 22, 2016 at 12:21 AM, Mich Talebzadeh <mich.talebza...@gmail.com > wrote: > > Hi, > > Anyone know which jar file has import org.apache.spark.internal.Logging? > > I tried *spark-core_2.10-1.5.1.

Which jar file has import org.apache.spark.internal.Logging

Hi, Anyone know which jar file has import org.apache.spark.internal.Logging? I tried *spark-core_2.10-1.5.1.jar * but does not seem to work scala> import org.apache.spark.internal.Logging :57: error: object internal is not a member of package org.apache.spark imp