Snehalata, Are you using the console consumer? You can pass a --from-beginning flag to the console consumer to get all the messages posted to that topic.
Thanks, Swapnil On 4/18/13 1:32 AM, "Snehalata Nagaje" <snehalata.nag...@harbingergroup.com> wrote: >Hi Neha, > >I was able to figure this out, this is happening due to time based >rolling. > >But now problem, when I fetch the messages for particular topic, server is >reading only one log file, returns those messages only. > >Is there any way I can combine all log files which are already produced >into >one, so that I can get all messages posted in that topic. > >Thanks, >Snehalata > > >-----Original Message----- >From: Snehalata Nagaje [mailto:snehalata.nag...@harbingergroup.com] >Sent: Thursday, April 18, 2013 11:41 AM >To: users@kafka.apache.org >Subject: RE: producer creating multiple log files after message sending > >Thanks Neha, > >-----Original Message----- >From: Neha Narkhede [mailto:neha.narkh...@gmail.com] >Sent: Wednesday, April 17, 2013 9:08 PM >To: users@kafka.apache.org >Subject: Re: producer creating multiple log files after message sending > >Hi Snehalata, > >Would you grep through the log4j files for the topic under >consideration and look for "Rolling.*due to". This will tell us why >the log is getting rolled over. > >Thanks, >Neha > >On Wed, Apr 17, 2013 at 12:05 AM, Snehalata Nagaje ><snehalata.nag...@harbingergroup.com> wrote: >> Hi, >> >> >> >> I am using kafak 0.8 version and sending messages to kafka server using >> below code, >> >> >> >> Producer<Integer, String> producer = new Producer<Integer, String>(new >> ProducerConfig(props)); >> >> producer.send(new KeyedMessage(topicName,partitionKey,jsonString)); >> >> producer.close(); >> >> >> >> I am able to post messages with, but after certain days, kafka creating >> multiple log files, messages are posted in new log file, although old >>file >> size is very less. >> >> >> >> What can be the reason for creating multiple log files? Does message >format >> matters while sending message to kafka? >> >> >> >> Thanks, >> >> Snehalata >> >> >> Disclaimer: >> This e-mail may contain Privileged/Confidential information and is >intended only for the individual(s) named. Any review, retransmission, >dissemination or other use of, or taking of any action in reliance upon >this >information by persons or entities other than the intended recipient is >prohibited. Please notify the sender, if you have received this e-mail by >mistake and delete it from your system. Information in this message that >does not relate to the official business of the company shall be >understood >as neither given nor endorsed by it. E-mail transmission cannot be >guaranteed to be secure or error-free. The sender does not accept >liability >for any errors or omissions in the contents of this message which arise >as a >result of e-mail transmission. If verification is required please request >a >hard-copy version. Visit us at http://www.harbingergroup.com/ > >Disclaimer: >This e-mail may contain Privileged/Confidential information and is >intended >only for the individual(s) named. Any review, retransmission, >dissemination >or other use of, or taking of any action in reliance upon this information >by persons or entities other than the intended recipient is prohibited. >Please notify the sender, if you have received this e-mail by mistake and >delete it from your system. Information in this message that does not >relate >to the official business of the company shall be understood as neither >given >nor endorsed by it. E-mail transmission cannot be guaranteed to be secure >or >error-free. The sender does not accept liability for any errors or >omissions >in the contents of this message which arise as a result of e-mail >transmission. If verification is required please request a hard-copy >version. Visit us at http://www.harbingergroup.com/ > >Disclaimer: >This e-mail may contain Privileged/Confidential information and is >intended only for the individual(s) named. Any review, retransmission, >dissemination or other use of, or taking of any action in reliance upon >this information by persons or entities other than the intended recipient >is prohibited. Please notify the sender, if you have received this e-mail >by mistake and delete it from your system. Information in this message >that does not relate to the official business of the company shall be >understood as neither given nor endorsed by it. E-mail transmission >cannot be guaranteed to be secure or error-free. The sender does not >accept liability for any errors or omissions in the contents of this >message which arise as a result of e-mail transmission. If verification >is required please request a hard-copy version. Visit us at >http://www.harbingergroup.com/
