You should look at the kafka-connect-jdbc code. It is a kafka connector to
load data into a relational database.
https://github.com/confluentinc/kafka-connect-jdbc
The documentation is here -
https://docs.confluent.io/current/connect/connect-jdbc/docs/index.html
On Fri, Oct 13, 2017 at 12:29 P
You should look at the kafka-connect-jdbc code. It is a kafka connector to
load data into a relational database.
https://github.com/confluentinc/kafka-connect-jdbc
The documentation is here -
https://docs.confluent.io/current/connect/connect-jdbc/docs/index.html
On Fri, Oct 13, 2017 at 12:29 P
Hello Kafka users, developers and client-developers,
This is the second candidate for release of Apache Kafka 1.0.0.
It's worth noting that starting in this version we are using a different
version protocol with three digits: *major.minor.bug-fix*
Any and all testing is welcome, but the followin
Hello,
with recent Kafka, would it be okay to have about 1000 topics, with between
1000 to 3000 partitions each, on a 6-node Kafka cluster with replication factor
3?
Each partition would be written to by one producer and consumed by one
consumer, with about 2 messages per minute coming in.
Wo
Hello,
I am looking for some advice or best practice: I want to update OR insert a
relational database table from kafka messages. As in Kafka everything is an
"insert", what is the best way to determine if I need to update or to insert
the data?
Do I have to write some code (which would be
On Wed, Oct 4, 2017 at 9:44 AM, Jakub Scholz wrote:
> Hi,
>
> I have some questions about the configuration of the Kafka Connect REST
> interface.
>
> 1) What are the configuration options rest.advertised.host.name
> and rest.advertised.port useful for? The documentation says "If this is
> set, t
On Tue, Oct 10, 2017 at 8:31 AM, Jehan Bruggeman
wrote:
> Hello,
>
> I'm trying to use a custom converter with Kafka Connect and I cannot seem
> to get it right. I'm hoping someone has experience with this and could help
> me figure it out !
>
>
> Initial situation
>
>
> - my cus
Hi,
You can get lag as a metric here:
https://kafka.apache.org/0100/javadoc/org/apache/kafka/clients/consumer/KafkaConsumer.html#metrics()
.
BR,
Stas.
2017-10-13 2:08 GMT+02:00 Stephen Powis :
> So I have the same use case as the original poster and had the same issue
> with the older 0.10.x cl
Hi,
I would like to understand how does __consumer_offsets work (kafka
0.11.0.0)? If I look at the contents of this topic for a particular
consumer group (e.g. pigeon):
#./kafka-console-consumer.sh --bootstrap-server localhost:9092 --topic
__consumer_offsets --from-beginning --formatter
"kafka.co
