see http://kafka.apache.org/documentation.html#consumerconfigs
fetch.message.max.bytes in the kafka params passed to the constructor On Wed, Aug 26, 2015 at 10:39 AM, Shushant Arora <shushantaror...@gmail.com> wrote: > whats the default buffer in spark streaming 1.3 for kafka messages. > > Say In this run it has to fetch messages from offset 1 to 10000. will it > fetch all in one go or internally it fetches messages in few messages > batch. > > Is there any setting to configure this no of offsets fetched in one batch? >
