-improved-scheduler-performance-for-large-scale-jobs-part-one/
* https://shopify.engineering/optimizing-apache-flink-applications-tips
* https://github.com/apache/flink-benchmarks
*
https://github.com/aws-samples/amazon-kinesis-data-analytics-flink-benchmarking-utility
--
Robin Moffatt
Principal DevEx
Looking at the release notes [1] it lists `DESCRIBE DATABASE` (FLINK-14879)
and `DESCRIBE CATALOG` (FLINK-14690).
When I try these in 1.19 RC2 the behaviour is as in 1.18.1, i.e. it is not
supported:
```
[INFO] Execute statement succeed.
Flink SQL> show catalogs;
+-+
|catalog
ao Chen
> --
> *From:* Feng Jin
> *Sent:* Friday, March 8, 2024 9:46
> *To:* Xuyang
> *Cc:* Robin Moffatt ; user@flink.apache.org <
> user@flink.apache.org>
> *Subject:* Re: Re: Running Flink SQL in production
>
> Hi,
>
> If you
I'm reading the deployment guide[1] and wanted to check my understanding.
For deploying a SQL job into production, would the pattern be to write the
SQL in a file that's under source control, and pass that file as an
argument to SQL Client with -f argument (as in this docs example[2])?
Or script a
Hi,
I have a netiquette question - is it ok to share blog posts here that
are specific to Apache Flink and not vendor-focussed?
thanks,
Robin.
[
https://issues.apache.org/jira/browse/FLINK-34437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Robin Moffatt updated FLINK-34437:
--
Description:
{code:java}
Flink SQL> CREATE CATALOG c_new WITH ('type'='generic_in_mem
Robin Moffatt created FLINK-34437:
-
Summary: Typo in SQL Client - `s/succeed/succeeded`
Key: FLINK-34437
URL: https://issues.apache.org/jira/browse/FLINK-34437
Project: Flink
Issue Type: Bug
Robin Moffatt created FLINK-34437:
-
Summary: Typo in SQL Client - `s/succeed/succeeded`
Key: FLINK-34437
URL: https://issues.apache.org/jira/browse/FLINK-34437
Project: Flink
Issue Type: Bug
In FLIP-69 [1] it looks like DESCRIBE CATALOG was added, but when I
try it from SQL Client in 1.18.1 it doesn't seem to work
Flink SQL> SHOW CATALOGS;
+-+
|catalog name |
+-+
| c_new |
| default_catalog |
+-+
2 rows in set
Flink SQL>
[
https://issues.apache.org/jira/browse/FLINK-33587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Robin Moffatt updated FLINK-33587:
--
Description:
The documentation around using JDBC with Flink is, IMHO, a bit disjointed
Robin Moffatt created FLINK-33587:
-
Summary: Tidy up docs around JDBC
Key: FLINK-33587
URL: https://issues.apache.org/jira/browse/FLINK-33587
Project: Flink
Issue Type: Improvement
Robin Moffatt created FLINK-33587:
-
Summary: Tidy up docs around JDBC
Key: FLINK-33587
URL: https://issues.apache.org/jira/browse/FLINK-33587
Project: Flink
Issue Type: Improvement
Robin Moffatt created FLINK-33537:
-
Summary: Docs version nav is missing 1.18 as an option
Key: FLINK-33537
URL: https://issues.apache.org/jira/browse/FLINK-33537
Project: Flink
Issue Type
Robin Moffatt created FLINK-33537:
-
Summary: Docs version nav is missing 1.18 as an option
Key: FLINK-33537
URL: https://issues.apache.org/jira/browse/FLINK-33537
Project: Flink
Issue Type
*Martijn, sorry!
On Fri, 10 Nov 2023 at 16:54, Robin Moffatt wrote:
> wonderful, thanks Martin!
>
> On Fri, 10 Nov 2023 at 09:56, Martijn Visser
> wrote:
>
>> Hi all,
>>
>> I've created https://issues.apache.org/jira/browse/FLINK-33516 and
>> I'll work
t; > Subject: Re: Adding a new channel to Apache Flink slack workspace
> >
> > +1 since there are so many questions wrt PyFlink.
> >
> > Best regards,
> > Jing
> >
> > On Tue, Nov 7, 2023 at 2:23 AM Robin Moffatt >
> > wrote:
> >
> >
tion from people who work on
> it.
>
> Best,
> Alexander
>
> On Wed, 25 Oct 2023 at 20:03, Robin Moffatt wrote:
>
> > Hi,
> >
> > I'd like to propose adding a PyFlink channel to the Apache Flink slack
> > workspace.
> >
> > By creating a channel
Hi,
I'd like to propose adding a PyFlink channel to the Apache Flink slack
workspace.
By creating a channel focussed on this it will help people find previous
discussions as well as target new discussions and questions to the correct
place. PyFlink is a sufficiently distinct component to make a
CTEs are supported, you can see an example in the docs [1] [2]. In the
latter doc, it also says
> CTEs are supported in Views, CTAS and INSERT statement
So I'm just guessing here, but your SQL doesn't look right.
The CTE needs to return a column called `pod`, and the `FROM` clause for
the
[
https://issues.apache.org/jira/browse/FLINK-33251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Robin Moffatt updated FLINK-33251:
--
Environment:
Macbook Pro
Apple M1 Max
{code:java}
$ uname -a
Darwin asgard08 23.0.0
Robin Moffatt created FLINK-33251:
-
Summary: SQL Client query execution aborts after a few seconds:
ConnectTimeoutException
Key: FLINK-33251
URL: https://issues.apache.org/jira/browse/FLINK-33251
Robin Moffatt created FLINK-33251:
-
Summary: SQL Client query execution aborts after a few seconds:
ConnectTimeoutException
Key: FLINK-33251
URL: https://issues.apache.org/jira/browse/FLINK-33251
[
https://issues.apache.org/jira/browse/FLINK-33218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Robin Moffatt updated FLINK-33218:
--
Description:
If a user of zsh (the default on MacOS) runs the literal command that's given
[
https://issues.apache.org/jira/browse/FLINK-33218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Robin Moffatt updated FLINK-33218:
--
Description:
If a user of zsh (the default on MacOS) runs the literal command that's given
Robin Moffatt created FLINK-33218:
-
Summary: First Steps - error when run with zsh
Key: FLINK-33218
URL: https://issues.apache.org/jira/browse/FLINK-33218
Project: Flink
Issue Type: Bug
Robin Moffatt created FLINK-33218:
-
Summary: First Steps - error when run with zsh
Key: FLINK-33218
URL: https://issues.apache.org/jira/browse/FLINK-33218
Project: Flink
Issue Type: Bug
You can contact Confluent here: https://confluent.io/contact
--
Robin Moffatt | Principal Developer Advocate | ro...@confluent.io | @rmoff
On Thu, 1 Sept 2022 at 09:44, Uzair Ahmed Mughal
wrote:
> can you please then provide the pricing plan of Confluent.
> Regards Uzair.
>
> O
.
--
Robin Moffatt | Principal Developer Advocate | ro...@confluent.io | @rmoff
On Thu, 1 Sept 2022 at 08:47, Uzair Ahmed Mughal
wrote:
> Hello, we are looking for a pricing plan for Kafka in detail, can you
> please help us out?
> Thanks and regards
> Uzair Mughal
> IVACY
>
Congrats Sophie, great news!
--
Robin Moffatt | Principal Developer Advocate | ro...@confluent.io | @rmoff
On Tue, 2 Aug 2022 at 00:42, Guozhang Wang wrote:
> Hi everyone,
>
> I'd like to introduce our new Kafka PMC member, Sophie. She has been a
> committer since Oct. 2020
Congrats Chris!
--
Robin Moffatt | Principal Developer Advocate | ro...@confluent.io | @rmoff
On Mon, 25 Jul 2022 at 17:26, Mickael Maison wrote:
> Hi all,
>
> The PMC for Apache Kafka has invited Chris Egerton as a committer, and
> we are excited to announce that he accepte
aker-at-current-2022-the-next-kafka-summit/.
If you have any questions about submitting I would be pleased to answer
them - you can contact me directly at ro...@confluent.io.
The call for speakers closes at June 26, 23:59 CT.
Thanks,
Robin Moffatt
Program Committee Chair
aker-at-current-2022-the-next-kafka-summit/.
If you have any questions about submitting I would be pleased to answer
them - you can contact me directly at ro...@confluent.io.
The call for speakers closes at June 26, 23:59 CT.
Thanks,
Robin Moffatt
Program Committee Chair
-transformations
--
Robin Moffatt | Principal Developer Advocate | ro...@confluent.io | @rmoff
On Tue, 3 May 2022 at 03:09, Liam Clarke-Hutchinson
wrote:
> Hi Emily,
>
> Nope, Kafka doesn't have that capability built in, it's just a distributed
> log that's great for streaming events. Howe
Hi Jordan,
Is there a good reason for wanting to do this? I can think of multiple
reasons why you shouldn't do this even if technically it works in some
cases.
Or it's just curiosity as to whether you can/should?
thanks, Robin.
--
Robin Moffatt | Principal Developer Advocate | ro
I *think* it should work - you just need to get your advertised.listeners
set up correctly. I wrote a blog about this that should help you understand
the config more:
www.confluent.io/blog/kafka-client-cannot-connect-to-broker-on-aws-on-docker-etc/
--
Robin Moffatt | Staff Developer Advocate
[
https://issues.apache.org/jira/browse/KAFKA-13520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17455207#comment-17455207
]
Robin Moffatt commented on KAFKA-13520:
---
Thanks Luke, good that it will be fixed. Is the release
[
https://issues.apache.org/jira/browse/KAFKA-13520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Robin Moffatt updated KAFKA-13520:
--
Affects Version/s: 3.0.0
> Quickstart does not work at topic creation s
[
https://issues.apache.org/jira/browse/KAFKA-13520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17455196#comment-17455196
]
Robin Moffatt commented on KAFKA-13520:
---
https://github.com/apache/kafka-site/pull/387
Robin Moffatt created KAFKA-13520:
-
Summary: Quickstart does not work at topic creation step
Key: KAFKA-13520
URL: https://issues.apache.org/jira/browse/KAFKA-13520
Project: Kafka
Issue Type
Robin Moffatt created KAFKA-13520:
-
Summary: Quickstart does not work at topic creation step
Key: KAFKA-13520
URL: https://issues.apache.org/jira/browse/KAFKA-13520
Project: Kafka
Issue Type
feel free to contact me directly - ro...@confluent.io.
thanks,
Robin Moffatt
P.S. Here’s a little-known fact about CfPs: at this stage, you don’t
need to have written the talk itself - just the abstract. If your talk
is accepted then you need to write it :)
[1] https://www.kafka-summit.org/
[2
[
https://issues.apache.org/jira/browse/KAFKA-13374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17430590#comment-17430590
]
Robin Moffatt commented on KAFKA-13374:
---
Looks good to me as a layperson - thanks for picking
Robin Moffatt created KAFKA-13374:
-
Summary: [Docs] - All reads from the leader of the partition even
after KIP-392?
Key: KAFKA-13374
URL: https://issues.apache.org/jira/browse/KAFKA-13374
Project
Robin Moffatt created KAFKA-13374:
-
Summary: [Docs] - All reads from the leader of the partition even
after KIP-392?
Key: KAFKA-13374
URL: https://issues.apache.org/jira/browse/KAFKA-13374
Project
Kafka Summit Americas 2021 starts tomorrow - register for free at
https://www.myeventi.events/kafka21/na/ and tune in for tons of
great Apache Kafka content!
--
Robin Moffatt | Staff Developer Advocate | ro...@confluent.io | @rmoff
Congratulations Konstantine!
--
Robin Moffatt | Senior Developer Advocate | ro...@confluent.io | @rmoff
On Mon, 21 Jun 2021 at 16:28, Mickael Maison wrote:
> Hi,
>
> It's my pleasure to announce that Konstantine Karantasis is now a
> member of the Kafka PMC.
>
> Ko
There's also this
https://forum.confluent.io/t/kafka-connect-jmespath-expressive-content-based-record-filtering/1104
which is worth checking out - I came across it after recording that video
unfortunately but it looks like a useful predicate implementation.
--
Robin Moffatt | Senior Developer
Great news, congratulations Randall!
--
Robin Moffatt | Senior Developer Advocate | ro...@confluent.io | @rmoff
On Sat, 17 Apr 2021 at 00:45, Matthias J. Sax wrote:
> Hi,
>
> It's my pleasure to announce that Randall Hauch in now a member of the
> Kafka PMC.
>
> Randal
Satendra - there was a new blog published just today about
running Confluent Control Center on Windows:
https://www.confluent.io/blog/set-up-and-run-kafka-on-windows-and-wsl-2
--
Robin Moffatt | Senior Developer Advocate | ro...@confluent.io | @rmoff
On Fri, 26 Mar 2021 at 10:07, Robin
You can use WSL2:
https://www.confluent.io/blog/set-up-and-run-kafka-on-windows-linux-wsl-2
--
Robin Moffatt | Senior Developer Advocate | ro...@confluent.io | @rmoff
On Fri, 26 Mar 2021 at 05:09, Satendra Negi
wrote:
> Hello Guys,
>
> Is there any way to run the confluent kafk
still have a properties file to configure
the worker itself.
--
Robin Moffatt | Senior Developer Advocate | ro...@confluent.io | @rmoff
On Tue, 23 Mar 2021 at 02:02, Himanshu Shukla
wrote:
> Hi All,
>
> I am having these below understanding regarding Kafka connect.
>
> 1
There is a similar discussion about Kafka Connect images here:
https://issues.apache.org/jira/browse/KAFKA-9774
--
Robin Moffatt | Senior Developer Advocate | ro...@confluent.io | @rmoff
On Tue, 16 Mar 2021 at 16:04, Francois Papon
wrote:
> Hi,
>
> It would be nice to push an
Congratulations Tom!
--
Robin Moffatt | Senior Developer Advocate | ro...@confluent.io | @rmoff
On Mon, 15 Mar 2021 at 18:00, Mickael Maison wrote:
> Hi all,
>
> The PMC for Apache Kafka has invited Tom Bentley as a committer, and
> we are excited to announce that he accep
For what it's worth, that sounds less like a Kafka Connector and more like
a Kafka Streams app.
--
Robin Moffatt | Senior Developer Advocate | ro...@confluent.io | @rmoff
On Thu, 11 Mar 2021 at 18:27, Nick Siviglia wrote:
> Hi Everyone,
>
> I'd like to create a Kafka connector tha
of it here:
https://forum.confluent.io/t/kafka-connect-jmespath-expressive-content-based-record-filtering/1104
--
Robin Moffatt | Senior Developer Advocate | ro...@confluent.io | @rmoff
On Wed, 10 Mar 2021 at 09:55, raman gugnani
wrote:
> HI Tom,
>
> For which connector class conne
I wrote a blog about loading data into Apache Kafka using kafkacat. It's
kinda hacky, but it works and was an interesting journey through some other
bash tools too :D
https://rmoff.net/2021/02/26/loading-delimited-data-into-kafka-quick-dirty-but-effective/
--
Robin Moffatt | Senior Developer
You can read about the security available in Apache Kafka here:
https://kafka.apache.org/documentation/#security_ssl
--
Robin Moffatt | Senior Developer Advocate | ro...@confluent.io | @rmoff
On Tue, 16 Feb 2021 at 15:18, Jones, Isaac wrote:
> Hello,
>
> I have a couple important
Headers: %h\n'
--
Robin Moffatt | Senior Developer Advocate | ro...@confluent.io | @rmoff
On Wed, 10 Feb 2021 at 17:59, Rovere Lorenzo wrote:
> Hi
>
>
>
> We are on Kafka version: 2.2.1-kafka-4.1.0
>
> We have some issues when trying to dump some messages from a topi
Robin Moffatt created KAFKA-10865:
-
Summary: Improve trace-logging for Transformations (including
Predicates)
Key: KAFKA-10865
URL: https://issues.apache.org/jira/browse/KAFKA-10865
Project: Kafka
Robin Moffatt created KAFKA-10865:
-
Summary: Improve trace-logging for Transformations (including
Predicates)
Key: KAFKA-10865
URL: https://issues.apache.org/jira/browse/KAFKA-10865
Project: Kafka
/
thanks, Robin.
--
Robin Moffatt | Senior Developer Advocate | ro...@confluent.io | @rmoff
On Mon, 14 Dec 2020 at 16:30, Ryanne Dolan wrote:
> Robin, I don't think this is an appropriate use of the user group.
>
> Ryanne
>
> On Mon, Dec 14, 2020 at 10:20 AM Robin
#TwelveDaysOfSMT
Day 5️⃣: MaskField
https://rmoff.net/2020/12/14/twelve-days-of-smt-day-5-maskfield/
--
Robin Moffatt | Senior Developer Advocate | ro...@confluent.io | @rmoff
On Fri, 11 Dec 2020 at 17:14, Robin Moffatt wrote:
> #TwelveDaysOfSMT
>
> Day 4️⃣: Re
#TwelveDaysOfSMT
Day 4️⃣: RegexRouter
https://rmoff.net/2020/12/11/twelve-days-of-smt-day-4-regexrouter/
--
Robin Moffatt | Senior Developer Advocate | ro...@confluent.io | @rmoff
On Thu, 10 Dec 2020 at 17:56, Robin Moffatt wrote:
> Here's the third instalm
Here's the third instalment of #TwelveDaysOfSMT
Flatten :https://rmoff.net/2020/12/10/twelve-days-of-smt-day-3-flatten/
--
Robin Moffatt | Senior Developer Advocate | ro...@confluent.io | @rmoff
On Thu, 10 Dec 2020 at 09:49, Robin Moffatt wrote:
> Here's the second instalm
Here's the second instalment of #TwelveDaysOfSMT
Day 2: ValueToKey and ExtractField :
https://rmoff.net/2020/12/09/twelve-days-of-smt-day-2-valuetokey-and-extractfield/
--
Robin Moffatt | Senior Developer Advocate | ro...@confluent.io | @rmoff
On Wed, 9 Dec 2020 at 09:07, Robin
/
Reply here with any feedback, any particular SMT you'd like me to explore,
or scenarios to solve :)
--
Robin Moffatt | Senior Developer Advocate | ro...@confluent.io | @rmoff
Why is quantity a STRING? Should it be a numeric?
--
Robin Moffatt | Senior Developer Advocate | ro...@confluent.io | @rmoff
On Tue, 8 Sep 2020 at 08:52, Rainer Schamm wrote:
> Hi all
>
> we are struggling a bit with a fairly simple stream that is supposed to
> map columns
, Robin.
--
Robin Moffatt | Senior Developer Advocate | ro...@confluent.io | @rmoff
On Mon, 7 Sep 2020 at 10:00, Himanshu Shukla
wrote:
> Hi,
> We are planning to go for amazon MSK instead of having our own self
> launched cluster on bare EC2 machines.
>
> It would be very help
I echo what Michael says here.
Another consideration is that logos are often shrunk (when used on slides)
and need to work at lower resolution (think: printing swag, stitching
socks, etc) and so whatever logo we come up with needs to not be too fiddly
in the level of detail - something that I
I echo what Michael says here.
Another consideration is that logos are often shrunk (when used on slides)
and need to work at lower resolution (think: printing swag, stitching
socks, etc) and so whatever logo we come up with needs to not be too fiddly
in the level of detail - something that I
For MongoDB connectors see https://www.confluent.io/hub/#mongodb
--
Robin Moffatt | Senior Developer Advocate | ro...@confluent.io | @rmoff
On Mon, 27 Jul 2020 at 18:19, Milka Wafula wrote:
> Hello,
>
> Please how may we connect mongoDB with kafka
&
Check out this article where it covers decimal handling:
https://www.confluent.io/blog/kafka-connect-deep-dive-jdbc-source-connector/#bytes-decimals-numerics
--
Robin Moffatt | Senior Developer Advocate | ro...@confluent.io | @rmoff
On Thu, 2 Jul 2020 at 13:54, vishnu murali
wrote:
>
If you're going to cross-post, it's useful to include where else you've
asked this before, so that people can see what else has been suggested and
answered to avoid duplicating their effort :)
https://stackoverflow.com/questions/62343035/kafka-entity-default-vs-entity-name
--
Robin Moffatt
You might also find this resource useful in general:
https://www.confluent.io/whitepaper/comparing-confluent-platform-with-traditional-messaging-middleware/
--
Robin Moffatt | Senior Developer Advocate | ro...@confluent.io | @rmoff
On Wed, 10 Jun 2020 at 16:00, נתי אלמגור
wrote
gt;
> Thanks,
> Yu
>
> On Thu, May 28, 2020 at 6:01 PM Robin Moffatt wrote:
> >
> > When you create the connector, it will start.
> >
> >
> > --
> >
> > Robin Moffatt | Senior Developer Advocate | ro...@confluent.io | @rmoff
> >
&g
When you create the connector, it will start.
--
Robin Moffatt | Senior Developer Advocate | ro...@confluent.io | @rmoff
On Thu, 28 May 2020 at 04:12, Yu Watanabe wrote:
> Dear community .
>
> I would like to ask question related to source connector in kafka
> co
The KIP for the current rebalancing protocol is probably a good reference:
https://cwiki.apache.org/confluence/display/KAFKA/KIP-415:+Incremental+Cooperative+Rebalancing+in+Kafka+Connect
--
Robin Moffatt | Senior Developer Advocate | ro...@confluent.io | @rmoff
On Tue, 26 May 2020 at 14:25
See here:
https://docs.confluent.io/current/security/basic-auth.html#basic-auth-kconnect
--
Robin Moffatt | Senior Developer Advocate | ro...@confluent.io | @rmoff
On Fri, 22 May 2020 at 15:42, wrote:
> Hi Team,
>
> I have configured a Kafka Connect source connector on Distribut
an
actual one. If this is an actual problem that you're encountering and need
a solution to then since the task allocation is not deterministic it sounds
like you need to deploy separate worker clusters based on the workload
patterns that you are seeing and machine resources available.
--
Robin Moffatt | Sen
available.
--
Robin Moffatt | Senior Developer Advocate | ro...@confluent.io | @rmoff
On Wed, 20 May 2020 at 16:39, Deepak Raghav
wrote:
> Hi Robin
>
> Replying to your query i.e
>
> One thing I'd ask at this point is though if it makes any difference where
> the tasks execut
difference where
the tasks execute? The point of a cluster is that Kafka Connect manages the
workload allocation. If you need workload separation and
guaranteed execution locality I would suggest separate Kafka Connect
distributed clusters.
--
Robin Moffatt | Senior Developer Advocate | ro
to you (if so please describe why), or if you're just
interested in the theory behind the rebalancing protocol?
--
Robin Moffatt | Senior Developer Advocate | ro...@confluent.io | @rmoff
On Wed, 20 May 2020 at 06:46, Deepak Raghav
wrote:
> Hi
>
> Please, can anybod
Hi Vishnu,
I think there is a problem with your email client, it's just sent a
duplicate of each of your emails from yesterday?
thanks, Robin.
On Tue, 19 May 2020 at 16:44, vishnu murali
wrote:
> Hi Guys
>
> By Trying SFTP CSV SOURCE i am getting this exception by using this
> configuration.
You need to externalise your container data stores. Here's an
example Docker Compose that does that:
https://github.com/confluentinc/demo-scene/blob/master/wifi-fun/docker-compose.yml
<https://github.com/confluentinc/demo-scene/blob/master/wifi-fun/docker-compose.yml#L10>
--
Robin M
Check this out: https://rmoff.dev/fix-jdbc-driver-video (specifically here
for Docker instructions https://www.youtube.com/watch?v=vI_L9irU9Pc=665s)
--
Robin Moffatt | Senior Developer Advocate | ro...@confluent.io | @rmoff
On Fri, 15 May 2020 at 08:16, vishnu murali
wrote:
> Hi i
If you just want it once then delete the connector once it's processed all
the data
--
Robin Moffatt | Senior Developer Advocate | ro...@confluent.io | @rmoff
On Thu, 14 May 2020 at 16:14, vishnu murali
wrote:
> Thanks Liam
>
> But I am asking like assume I am having 10.
-thereabouts-part-3/
-
https://www.confluent.io/blog/kafka-connect-deep-dive-jdbc-source-connector/
- http://rmoff.dev/ksldn19-kafka-connect
--
Robin Moffatt | Senior Developer Advocate | ro...@confluent.io | @rmoff
On Wed, 13 May 2020 at 10:34, vishnu murali
wrote:
> Hi Guys,
>
> i
components as is. When you configure Schema Registry
you point it at your existing Apache Kafka cluster (
https://docs.confluent.io/current/schema-registry/installation/config.html#schemaregistry-config
)
--
Robin Moffatt | Senior Developer Advocate | ro...@confluent.io | @rmoff
On Mon, 11 May 2020
> wirite to target database. I want to use self-written java code
instead of kafka jdbc sink connector.
Out of interest, why do you want to do this? Why not use the JDBC sink
connector (or a fork of it if you need to amend its functionality)?
--
Robin Moffatt | Senior Developer Advoc
You can use Apache Kafka as you are currently using, and just deploy Schema
Registry alongside it.
--
Robin Moffatt | Senior Developer Advocate | ro...@confluent.io | @rmoff
On Sat, 9 May 2020 at 02:16, Chris Toomey wrote:
> You have to either 1) use one of the Confluent serializ
Schema Registry and its serde libraries are part of Confluent Platform,
licensed under Confluent Community Licence (
https://www.confluent.io/confluent-community-license-faq/)
--
Robin Moffatt | Senior Developer Advocate | ro...@confluent.io | @rmoff
On Fri, 8 May 2020 at 13:39, vishnu
://www.youtube.com/watch?v=b-3qN_tlYR4=627s
--
Robin Moffatt | Senior Developer Advocate | ro...@confluent.io | @rmoff
On Thu, 7 May 2020 at 06:48, vishnu murali
wrote:
> Hey Guys,
>
> i am working on JDBC Sink Conneector to take data from kafka topic to
> mysql.
>
> i am having
Are you talking about MirrorMaker 2? That runs as a connector.
If not, perhaps you can clarify your question a bit as to what it is you
are looking for.
--
Robin Moffatt | Senior Developer Advocate | ro...@confluent.io | @rmoff
On Fri, 1 May 2020 at 13:57, vishnu murali
wrote:
> Hi G
How are you running Kafka? Do you mean when you shut it down you have to
reconfigure the connector?
--
Robin Moffatt | Senior Developer Advocate | ro...@confluent.io | @rmoff
On Wed, 29 Apr 2020 at 20:03, vishnu murali
wrote:
> Hi guys
> I am trying that JDBC source connector to ge
if Sybase supports JDBC then you can probably use the JDBC Source connector
for Kafka Connect
Ref:
https://www.confluent.io/blog/kafka-connect-deep-dive-jdbc-source-connector/
--
Robin Moffatt | Senior Developer Advocate | ro...@confluent.io | @rmoff
On Mon, 20 Apr 2020 at 17:31, Jonatan
(
https://airtable.com/shrzKAKFMcfIgFVK9/iCal?timeZone=Europe%2FLondon=en-gb)
or an online view here (https://cnfl.io/online-community-meetups)
--
Robin Moffatt | Senior Developer Advocate | ro...@confluent.io | @rmoff
I thought I'd share here a short blog I wrote up recently:
https://rmoff.net/2020/04/16/a-quick-and-dirty-way-to-monitor-data-arriving-on-kafka/
Enjoy :)
--
Robin Moffatt | Senior Developer Advocate | ro...@confluent.io | @rmoff
No. You have you restart the worker.
--
Robin Moffatt | Senior Developer Advocate | ro...@confluent.io | @rmoff
On Tue, 7 Apr 2020 at 18:24, nitin agarwal wrote:
> Hi,
>
> I have a use case where new connectors will keep on adding to existing
> running Kafka Connect cluster.
You probably want the Confluent Platform mailing list for this:
https://groups.google.com/forum/#!forum/confluent-platform (or Confluent
Platform slack group: http://cnfl.io/slack with the #control-center
channel). Or if you have a Confluent support contract, contact support :)
--
Robin
You need to make sure you've configured your listeners & advertised
listeners correctly. This should help:
https://rmoff.net/2018/08/02/kafka-listeners-explained/
--
Robin Moffatt | Senior Developer Advocate | ro...@confluent.io | @rmoff
On Thu, 19 Mar 2020 at 01:49, Dan Hill w
1 - 100 of 166 matches
Mail list logo
