Hi,
Can someone help on this topic?
Thank you
Enrico
Il Mer 27 Lug 2016 12:26 Enrico Olivelli - Diennea <
enrico.olive...@diennea.com> ha scritto:
> Hi,
> I'm running Kafka launching KafkaServerStartable inside my JVM (I'm using
> version 0.10.0.0).
>
> I'm accessing the internal KafkaServer fie
Hi, I am using kafka_2.11-0.9.0.1, there are multiple of warnings occur
in kafkaServer.out:
java.lang.OutOfMemoryError: Java heap space.
- the jstat output like this:
# jstat -gc 28591
S0CS1CS0US1U EC EUOC OU MC
MUCCSC CCSU YGC YGCT
Chris,
I think you meant to link to https://github.com/wepay/kafka-connect-bigquery
:)
- Samuel
On Mon, Aug 22, 2016 at 4:24 PM, Chris Egerton wrote:
> Hi there,
>
> We've recently open-sourced a BigQuery sink connector and would like to
> request that it be added to the Kafka Connector H
Hi there,
We've recently open-sourced a BigQuery sink connector and would like to
request that it be added to the Kafka Connector Hub (
https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Connector+Hub). The
project can be found at https://github.com/wepay/kafka-connect-biquery, and
the co
Take a look at jmxtrans: https://github.com/jmxtrans. There are a number of
options, including some ones you can ebmed into your java application.
-Dave
-Original Message-
From: Lawrence Weikum [mailto:lwei...@pandora.com]
Sent: Monday, August 22, 2016 2:32 PM
To: users@kafka.apache.or
Hello,
We’re looking into the functionality of Metrics Reporters for producers and
consumers in Kafka 0.10. Are there any projects that can be recommended that
seem promising; specifically involving sending metrics to either StatsD or
Graphite?
As always, thank you for your help!
Lawrence We
Hi, Jason
This scenario is supported.
Just set config option
auto.leader.rebalance.enable=false
And use tool kafka-preferred-replica-election.sh
If you want to move leader from one host to another use tool
kafka-reassign-partitions.sh with same replica list but other order
22.08.2016, 20:36, "J
Looks super interesting, will deploy into our environment tomorrow to test.
On Monday, 22 August 2016, David Esposito
wrote:
> We are looking for some feedback on a Kafka tool used for debugging
> micro-services.
>
> At BetterCloud we use Kafka and Avro with fairly complex model schemas. It
> wa
We are looking for some feedback on a Kafka tool used for debugging
micro-services.
At BetterCloud we use Kafka and Avro with fairly complex model schemas. It
was close to impossible to test on CLI so we built a web based tool for
consuming/producing to topics. It has proven to be extremely valuab
Thank you,
Glad to see it is addressed.
On Mon, Aug 22, 2016 at 8:36 PM, Dustin Cote wrote:
> Hi Michael,
>
> You'd probably be interested in the discussion for this KIP:
> https://cwiki.apache.org/confluence/display/KAFKA/KIP-
> 75+-+Add+per-connector+Converters
>
> For now, you'd have to run d
Hi Kamal,
Thanks for reporting this. I think we can carry the paused partitions info
across rebalances so that if the partitions are assigned to the consumers
again they are still automatically paused (currently we reset such
information after rebalance).
Guozhang
On Sun, Aug 21, 2016 at 10:10
I am looking into Kafka Connect and Confluent HDFSSinkConnector.
The goal is to save data from various topics to HDFS.
We have at least two different formats of the data in Kafka - raw data
(JSON) - that we want to save as SequenceFile and normalized data
(Protobuf) that we want to save as Parquet
Hi Michael,
You'd probably be interested in the discussion for this KIP:
https://cwiki.apache.org/confluence/display/KAFKA/KIP-
75+-+Add+per-connector+Converters
For now, you'd have to run different Connect instances, but KIP-75 plans to
let you have control over converters at a connector level.
I have a use case that requires a 2 node deployment with a Kafka-backed
service with the following constraints:
- All data must be persisted to node 1. If node 1 fails (regardless of the
status of node 2), then the system must stop.
- If node 2 is up, then it must stay in synch with node 1.
- If
Jan,
Currently, there is no switch to disable the time based index.
There are quite a few use cases of time based index.
1. From KIP-33's wiki, it allows us to do time-based retention accurately.
Before KIP-33, the time-based retention is based on the last modified time
of each log segment. The
Can you describe the behavior you saw that you didn't like?
-Jay
On Mon, Aug 22, 2016 at 12:24 AM, Jan Filipiak
wrote:
> Hello everyone,
>
> I stumbled across KIP-33 and the time based index, while briefly checking
> the wiki and commits, I fail to find a way to opt out.
> I saw it having quite
Hi,
Can anybody provide any guidance on the following:
1. Given a limited set of groups and consumers, will increasing
'offsets.retention.minutes' to a high value (say 30 days) cause the
__consumer_offsets topic to bloat unnecessarily or will compaction ensure that
the entries for each key rem
Hi Sankar,
It looks like Kafka's build scripts are not compatible with Gradle
3.0. I'd suggest using the gradle wrapper (./gradlew) included in the
Kafka repo, which will automatically install Gradle 2.13 which is
compatible with the build scripts.
Mathieu
On Mon, Aug 22, 2016 at 3:00 AM, Sank
Hi,
I am facing the below issue while trying to build kafka using gradle. can
you please help?
installed grade 3.0 and then git clone kafka from apache site. Then I ran
gradle under kafka folder. But I got the error "No such property: useAnt
for class: org.gradle.api.tasks.scala.ScalaCompileOpt
Hello everyone,
I stumbled across KIP-33 and the time based index, while briefly
checking the wiki and commits, I fail to find a way to opt out.
I saw it having quite some impact on when logs are rolled and was hoping
not to have to deal with all of that. Is there a disable switch I
overlooked
20 matches
Mail list logo
