Re: [jira] [Updated] (KAFKA-278) Issues partitioning a new topic

2012-04-19 Thread Bao Thai Ngo
Hi there, Is there any news on this issue? Thanks, ~Thai On Fri, Mar 16, 2012 at 8:04 AM, Matt (Updated) (JIRA) wrote: > > [ > https://issues.apache.org/jira/browse/KAFKA-278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel] > > Matt updated KAFKA-278: > ---

Re: Kafka is live in prod @ 100%

2012-03-04 Thread Bao Thai Ngo
he number of partitions differently for > so many topics ? > I wonder if setting the right default for num.partitions works instead ? > > Thanks, > Neha > > On Sun, Feb 19, 2012 at 6:47 PM, Bao Thai Ngo > wrote: > > Hi, > > > > I like the ide

Re: Kafka is live in prod @ 100%

2012-02-19 Thread Bao Thai Ngo
e didn't solve this problem. We had to use the global > > > topic settings that apply to all topics. > > > > > > I would really like to see globs (wildcards) supported in the config > > > settings. This is something my team and I have discussed on several >

Re: Kafka is live in prod @ 100%

2012-02-17 Thread Bao Thai Ngo
Hi Taylor, I found your email and the Kafka use case by chance. Our use case is a little similar to yours. We actually implement semantic partitioning to maintain some kind of produced data and we are also running several thousand topics as you. One issue we have been facing is that it is totally

Re: Retrieve Partition-Id from MessageStream

2011-12-07 Thread Bao Thai Ngo
Hi, As far as I understand you intends to use semantic partitioning to maintain some kind of produced data. This allows you to partition stream of messages with some semantic partition function based on some key in message. At consumer side, you also want to map semantic partitions with host (serv

Re: kafka message format

2011-10-26 Thread Bao Thai Ngo
ve the discussion for a JIRA: > https://issues.apache.org/jira/browse/KAFKA-171 > > On Wed, Oct 26, 2011 at 12:12 AM, Bao Thai Ngo wrote: > >> Hi, >> >> We have just made inspection on the message format and found some >> information unclear to us. Before the invest

kafka message format

2011-10-26 Thread Bao Thai Ngo
Hi, We have just made inspection on the message format and found some information unclear to us. Before the investigation, I did know that each Kafka message has an overhead of only 10 bytes. Below is what we have done with Kafka 0.7 RC2 on a CentOS 5.6 server: - start kafka server on port -

Re: broken unit test

2011-10-03 Thread Bao Thai Ngo
Hi, I get the following errors when running sbt release-zip: [info] Test Starting: testUnreachableServer First message send retries took 10038 ms [error] Test Failed: testUnreachableServer junit.framework.AssertionFailedError: null at junit.framework.Assert.fail(Assert.java:47) at junit.framework