Re: Producer Bug? Moving form 0.9.0.1 to 0.10.1.0-SNAPSHOT (latest)

2016-04-19 Thread Greg Zoller
 Otherwise, it will use the value # returned from java.net.InetAddress.getCanonicalHostName(). I dunno what to say.  I'll keep flipping this and have a friend confirm the results.  Is some code or script textually looking at this file (not parsing it) for either of these 2 things? From: Greg Zol

Re: Producer Bug? Moving form 0.9.0.1 to 0.10.1.0-SNAPSHOT (latest)

2016-04-16 Thread Greg Zoller
From: Ismael Juma <ism...@juma.me.uk> To: users@kafka.apache.org; Greg Zoller <gwzol...@yahoo.com> Sent: Saturday, April 16, 2016 6:47 PM Subject: Re: Producer Bug? Moving form 0.9.0.1 to 0.10.1.0-SNAPSHOT (latest) That's interesting, thanks for investigating this.

Re: Producer Bug? Moving form 0.9.0.1 to 0.10.1.0-SNAPSHOT (latest)

2016-04-16 Thread Greg Zoller
metadata. Now the fun part... I'm going to try to zero in to find the build, and therefore the change, that broke this functionality. More updates to follow... Greg From: Greg Zoller <gwzol...@yahoo.com.INVALID> To: "users@kafka.apache.org" <users@kafka.apache.org>

Re: Producer Bug? Moving form 0.9.0.1 to 0.10.1.0-SNAPSHOT (latest)

2016-04-16 Thread Greg Zoller
gt; > What is the broker version? Have you checked that there are no errors > logged in the broker? > > Ismael > > On Fri, Apr 15, 2016 at 11:55 PM, Greg Zoller <gwzol...@yahoo.com.invalid> > wrote: > >> ok... one more attempt for a working link... >>

Re: Producer Bug? Moving form 0.9.0.1 to 0.10.1.0-SNAPSHOT (latest)

2016-04-15 Thread Greg Zoller
gt; logged in the broker? > > Ismael > > On Fri, Apr 15, 2016 at 11:55 PM, Greg Zoller <gwzol...@yahoo.com.invalid> > wrote: > >> ok... one more attempt for a working link... >> https://gist.github.com/gzoller/145faef1fefc8acea212e87e06fc86e8 >> (If this doesn't

Re: Producer Bug? Moving form 0.9.0.1 to 0.10.1.0-SNAPSHOT (latest)

2016-04-15 Thread Greg Zoller
GIST: https://gist.github.com/gzoller/145faef1fefc8acea212e87e06fc86e8 From: Greg Zoller <gwzol...@yahoo.com.INVALID> To: "users@kafka.apache.org" <users@kafka.apache.org> Sent: Friday, April 15, 2016 5:51 PM Subject: Producer Bug? Moving form 0.9.0.1 to 0.10.1.0-S

Producer Bug? Moving form 0.9.0.1 to 0.10.1.0-SNAPSHOT (latest)

2016-04-15 Thread Greg Zoller
I have built 0.10.1.0-SNAPSHOT from scratch and used it with my KafkaProducer code from 0.9.0.1.It compiled just fine but when run it hangs (times out actually) on send().  I've created a gist below with a clip from the output in comments at the end of the file. Remember, this code worked

Re: [0.10.1.0-SNAPSHOT] KafkaProducer.close() not committing

2016-04-13 Thread Greg Zoller
) at org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:155) at java.lang.Thread.run(Thread.java:745)The offset of the record we just sent is: null So something is hanging up and then gets tied in knots when things finally shut down. From: Greg Zoller <gwzol...@yahoo.com.INVALID> To:

Re: [0.10.1.0-SNAPSHOT] KafkaProducer.close() not committing

2016-04-13 Thread Greg Zoller
aseStrings=LEADER_NOT_AVAILABLE}org.apache.kafka.common.errors.TimeoutException: Failed to update metadata after 59860 ms. From: Ismael Juma <ism...@juma.me.uk> To: users@kafka.apache.org; Greg Zoller <gwzol...@yahoo.com> Sent: Wednesday, April 13, 2016 5:54 PM Subject:

Re: [0.10.1.0-SNAPSHOT] KafkaProducer.close() not committing

2016-04-13 Thread Greg Zoller
So I rebuilt last night with the latest from master branch. Unfortunately same problem--producer doesn't seem to commit/close().  After inserting a few records (which *seem* to go ok), close() times out and no offsets are updated--still set to 0. Any ideas?Thanks,Greg From: Greg Zoller

Re: [0.10.1.0-SNAPSHOT] KafkaProducer.close() not committing

2016-04-12 Thread Greg Zoller
Sorry the formatting was all messed up.I re-tested this code with 0.9.0.1 and it worked fine--KafkaProducer closed and committed the number of records expected into the partitions. So this seems like a SNAPSHOT issue.  Will continue looking. From: Greg Zoller <gwzol...@yahoo.com.INVA

[0.10.1.0-SNAPSHOT] KafkaProducer.close() not committing

2016-04-12 Thread Greg Zoller
Hello, I'm trying to run the latest master build in github.  I've got producer code like below:    val props = Map(      "bootstrap.servers" -> host,       "key.serializer" -> "org.apache.kafka.common.serialization.ByteArraySerializer",      "value.serializer" ->

Re: [0.9.0.1] Having problems with commitAsync() not updating offsets

2016-04-07 Thread Greg Zoller
Hmm... gist didn't come thru for some reason.Trying agin: gist.github.com/gzoller/93fe2392fd3606bcb3b879e4ab2f8f6e From: Greg Zoller <gwzol...@yahoo.com.INVALID> To: "users@kafka.apache.org" <users@kafka.apache.org> Sent: Thursday, April 7, 2016 5:25 PM Sub

[0.9.0.1] Having problems with commitAsync() not updating offsets

2016-04-07 Thread Greg Zoller
Hello, I'm having trouble with commitAsync() not updating my partition offsets.  I pre-populate 1,000,000 strings on topic 'lowercaseStrings' across 4 partitions.  I check the offsets and they're fine--250K records/partition. Then I run some code that uses a single-thread with blocking queue to