Hi, I have a question about sampling Spark Streaming data, or getting part of the data. For every minute, I only want the data read in during the first 10 seconds, and discard all data in the next 50 seconds. Is there any way to pause reading and discard data in that period? I'm doing this to sample from a stream of huge amount of data, which saves processing time in the real-time program. Thanks!
- Pause Spark Streaming reading or sampling streami... foobar
- Pause Spark Streaming reading or sampling st... Heath Guo
- Re: Pause Spark Streaming reading or sam... Dimitris Kouzis - Loukas
- Re: Pause Spark Streaming reading or... Heath Guo
- Re: Pause Spark Streaming readin... Dimitris Kouzis - Loukas
- Re: Pause Spark Streaming r... Dimitris Kouzis - Loukas