Re: Stream S3 server to Cassandra

2016-01-28 Thread Alexandr Dzhagriev
Hello Sateesh, I think you can use a file stream, e.g. streamingContext.fileStream[KeyClass, ValueClass, InputFormatClass](dataDirectory) to create a stream and then process the RDDs as you are doing now. Thanks, Alex. On Thu, Jan 28, 2016 at 10:56 AM, Sateesh Karuturi <

Stream S3 server to Cassandra

2016-01-28 Thread Sateesh Karuturi
Hello Anyone... please help me to how to Stream the XML files from S3 server to cassandra db using Spark Streaming java. presently iam using Spark core to do that job..but problem is i have to to run for every 15 mints.. thats why iam looking for Spark Streaming.