Re: Multiple Kinesis Streams in a single Streaming job

2015-05-14 Thread Chris Fregly
>>>> >>>>> val rawStream = KinesisUtils.createStream(ssc, "erich-test", >>>>> "kinesis.us-east-1.amazonaws.com", Duration(1000), >>>>> InitialPositionInStream.TRIM_HORIZON, StorageLevel.MEM

Re: Multiple Kinesis Streams in a single Streaming job

2015-05-14 Thread Erich Ess
>>> "kinesis.us-east-1.amazonaws.com", Duration(1000), >>>> InitialPositionInStream.TRIM_HORIZON, StorageLevel.MEMORY_ONLY) >>>> rawStream.map(msg => new String(msg)).print >>>> >>>> val loaderStream

Re: Multiple Kinesis Streams in a single Streaming job

2015-05-14 Thread Tathagata Das
;>> rawStream.map(msg => new String(msg)).print >>> >>> val loaderStream = KinesisUtils.createStream( >>> ssc, >>> "dev-loader", >>> "kinesis.us-east-1.amazonaws.com", >>> Duration(1000), >>> Ini

Re: Multiple Kinesis Streams in a single Streaming job

2015-05-14 Thread Chris Fregly
;dev-loader", >> "kinesis.us-east-1.amazonaws.com", >> Duration(1000), >> InitialPositionInStream.TRIM_HORIZON, >> StorageLevel.MEMORY_ONLY) >> >> val loader = loaderStream.map(msg => new String(msg)).print

Re: Multiple Kinesis Streams in a single Streaming job

2015-05-14 Thread Tathagata Das
sis.us-east-1.amazonaws.com", > Duration(1000), > InitialPositionInStream.TRIM_HORIZON, > StorageLevel.MEMORY_ONLY) > > val loader = loaderStream.map(msg => new String(msg)).print > > ssc.start() > > Thanks, > -Erich > > > > -- > View this

Multiple Kinesis Streams in a single Streaming job

2015-05-14 Thread Erich Ess
-- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Multiple-Kinesis-Streams-in-a-single-Streaming-job-tp22889.html Sent from the Apache Spark User List mailing list archive at Nabble.com. - To uns