dear all,
My Kafka consumer program was stopped and at that time I was trying to get
some logs from Kafka broker and encountered this
// xxx.xxx.xxx.xxx is host containing Kafka consumer
> // ...
> [2016-01-04 12:06:21,676] ERROR Closing socket for /xxx.xxx.xxx.xxx
> because of error (kafka.netwo
Hi,
I'm looking for the syntax of the replicaAssignmentStr parameter of the
method AdminUtils.addPartitions.
For example, suppose I have brokers 0..5 and topic T with 2 partitions and
replication factor 3.
And I would like to add 2 more partitions with replicas on brokers 1,3,5.
What should be the
Hi list,
While the 0.9.0.0 client lib is great to work with, I extracted some of
the facade code I use internally into a library which smooths some
aspects of interacting with Kafka from Clojure.
The library provides a simple way to build rebalance listeners,
serializers and deserializers. It als
Hi Guys,
I have a project for replicating data from oracle databases using Goldengate
big data utilities to apache kafka and we intend to use Avro
formatter which requires Avro schemas. I am new to kafka and don't know how to
build Avro schemas or to link Apache kafka with GoldenGate
kafka adap
Very nice!
On Jan 7, 2016 04:41, "Pierre-Yves Ritschard" wrote:
> Hi list,
>
> While the 0.9.0.0 client lib is great to work with, I extracted some of
> the facade code I use internally into a library which smooths some
> aspects of interacting with Kafka from Clojure.
>
> The library provides a
Guozhang,
Thanks for the answer. just to be clear, there is no way to be sure that
I'm going to pull 1 record right?
Franco.
2015-12-31 20:18 GMT+01:00 Guozhang Wang :
> Franco,
>
> I think this is a mis-documentation of "poll(0)":
> https://issues.apache.org/jira/browse/KAFKA-3044
>
> As for y
Looks good! I've added it to the clients page here:
https://cwiki.apache.org/confluence/display/KAFKA/Clients
-Ewen
On Thu, Jan 7, 2016 at 9:12 AM, Dana Powers wrote:
> Very nice!
> On Jan 7, 2016 04:41, "Pierre-Yves Ritschard" wrote:
>
> > Hi list,
> >
> > While the 0.9.0.0 client lib is grea
Hi,
I am building my application using the rest proxy and I wanted to get some
clarification on the documentation.
"Because consumers are stateful, any consumer instances created with the REST
API are tied to a specific REST proxy instance. A full URL is provided when the
instance is created a
On Thu, Jan 7, 2016 at 12:54 PM, Heath Ivie wrote:
> Hi,
>
> I am building my application using the rest proxy and I wanted to get some
> clarification on the documentation.
>
> "Because consumers are stateful, any consumer instances created with the
> REST API are tied to a specific REST proxy i
Thanks Ewen.
I have that in my example, but when there are two consumers each with an
autogenerated id, only one can read and get data.
The second one will return an empty array, even with a message being published
after the first consumer is finished.
I see what is expected if I use the .NET
I think that the question I should be asking is how do I get more than 1
partition when using the rest client?
-Original Message-
From: Heath Ivie [mailto:hi...@autoanything.com]
Sent: Thursday, January 07, 2016 1:28 PM
To: users@kafka.apache.org
Subject: RE: Kafka-Rest question
Thanks
Hi,
There has been discussion on the ticket :
https://issues.apache.org/jira/browse/KAFKA-2887, that we are going to
deprecate auto-creation of topic or at least turn it off by default once we
have the CreateTopics API. It also says the patch is available for this.
The only other ticket that I ca
+ dev
Hi
There has been discussion on the ticket :
https://issues.apache.org/jira/browse/KAFKA-2887, that we are going to
deprecate auto-creation of topic or at least turn it off by default once we
have the CreateTopics API. It also says the patch is available for this.
The only other ticket tha
Hi
I have a straightforward piece of code that creates a consumer (Kafka 0.9.0.0).
Properties props = new Properties();
props.put("zookeeper.connect", zookeeperServers);
props.put(org.apache.kafka.clients.consumer.ConsumerConfig.GROUP_ID_CONFIG,
groupId);
log.info("Starting consumer group for
Hi Cosmin,
do you have default server configuration on these new nodes you're setting
up?
I'd check consumer's socket.timeout.ms, maybe someone set it to 30 instead
of 30 000 :)
Speaking from my own experience (I had the same symptom and this turned out
to be the cause).
Marko Bonaći
Monitoring |
Actually, why don't you use the same code as outlined here (that includes
timeout in props):
http://kafka.apache.org/090/javadoc/org/apache/kafka/clients/consumer/KafkaConsumer.html
Marko Bonaći
Monitoring | Alerting | Anomaly Detection | Centralized Log Management
Solr & Elasticsearch Support
Sem
The REST proxy doesn't currently handle topic creation, so you need to
either do that separately or set the num.partitions config for your brokers
if you are relying on topic auto creation. The default for num.partitions
is 1, which is probably why you're seeing the current behavior.
It'd be great
Hi, Everyone,
I wanted to remind you of a couple of Kafka Summit related deadlines coming
up.
On Monday Jan 11 the Call for Proposals closes at 11:59pm Pacific Time. We
encourage you to participate - share your stories and best practices.
Submit your proposal at www.kafka-summit.org
On Friday Ja
Hi,
Was able to setup Apache Kafka on Windows 10 and RHEL(Release 6.6
Santiago) systems and have both the Producer and Consumers up and running.
But since 2 days, I'm facing some issues with Kafka in RHEL env though the
same code is working on Windows 10.
The Zookeeper and the broker are starti
Hey!
So I upgraded our production kafka cluster from 0.8.2 to 0.9.0 this
morning, and it seems like everything went smoothly.
As the last step when I changed the inter.broker.protocol.version to
0.9.0.0 and did a rolling restart, I noticed that the FetchFollower request
times increased fairly sig
20 matches
Mail list logo
