Re: Kafka Connect Embedded API

[Debasish Ghosh]

Thanks for the information. I also had the same feeling after spending some
time with the current code base.

On Wed, Jul 26, 2017 at 12:30 PM, Ewen Cheslack-Postava 
wrote:

> The vast majority of KIP-26 has been implemented. Unfortunately, the
> embedded API is still one of the gaps that has not yet been implemented. It
> likely requires some additional design work as only a prototype API was
> proposed in the KIP describing the framework as a whole.
>
> -Ewen
>
> On Wed, Jul 12, 2017 at 10:45 AM, Debasish Ghosh  > wrote:
>
>> Thanks .. I found this blog post from Confluent
>> https://www.confluent.io/blog/hello-world-kafka-connect-kafka-streams/ ..
>> It's possibly pre-KIP 26, as the code base says ..
>>
>> /**
>>  * This is only a temporary extension to Kafka Connect runtime until there
>> is an Embedded API as per KIP-26
>>  */
>>
>> Has KIP-26 been implemented as of 0.11 ? And do users use embedded Kafka
>> Connect ?
>>
>> regards.
>>
>> On Wed, Jul 12, 2017 at 8:51 PM, David Garcia 
>> wrote:
>>
>> > I would just look at an example:
>> >  https://github.com/confluentinc/kafka-connect-jdbc
>> > https://github.com/confluentinc/kafka-connect-hdfs
>> >
>> >
>> >
>> >
>> >
>> > On 7/12/17, 8:27 AM, "Debasish Ghosh"  wrote:
>> >
>> > Hi -
>> >
>> > I would like to use the embedded API of Kafka Connect as per
>> > https://cwiki.apache.org/confluence/pages/viewpage.
>> > action?pageId=58851767.
>> > But cannot find enough details regarding the APIs and implementation
>> > models. Is there any sample example that gives enough details about
>> > embedded Kafka Connect APIs ?
>> >
>> > My use case is as follows :-
>> >
>> > I have a Kafka Streams app from which I plan to use a HDFS sink
>> > connector
>> > to write to HDFS. And plan to use embedded Kafka Connect API.
>> >
>> > regards.
>> >
>> > --
>> > Debasish Ghosh
>> > http://manning.com/ghosh2
>> > http://manning.com/ghosh
>> >
>> > Twttr: @debasishg
>> > Blog: http://debasishg.blogspot.com
>> > Code: http://github.com/debasishg
>> >
>> >
>> >
>>
>>
>> --
>> Debasish Ghosh
>> http://manning.com/ghosh2
>> http://manning.com/ghosh
>>
>> Twttr: @debasishg
>> Blog: http://debasishg.blogspot.com
>> Code: http://github.com/debasishg
>>
>
>


-- 
Debasish Ghosh
http://manning.com/ghosh2
http://manning.com/ghosh

Twttr: @debasishg
Blog: http://debasishg.blogspot.com
Code: http://github.com/debasishg

Re: Kafka Connect Embedded API

[Ewen Cheslack-Postava]

The vast majority of KIP-26 has been implemented. Unfortunately, the
embedded API is still one of the gaps that has not yet been implemented. It
likely requires some additional design work as only a prototype API was
proposed in the KIP describing the framework as a whole.

-Ewen

On Wed, Jul 12, 2017 at 10:45 AM, Debasish Ghosh 
wrote:

> Thanks .. I found this blog post from Confluent
> https://www.confluent.io/blog/hello-world-kafka-connect-kafka-streams/ ..
> It's possibly pre-KIP 26, as the code base says ..
>
> /**
>  * This is only a temporary extension to Kafka Connect runtime until there
> is an Embedded API as per KIP-26
>  */
>
> Has KIP-26 been implemented as of 0.11 ? And do users use embedded Kafka
> Connect ?
>
> regards.
>
> On Wed, Jul 12, 2017 at 8:51 PM, David Garcia 
> wrote:
>
> > I would just look at an example:
> >  https://github.com/confluentinc/kafka-connect-jdbc
> > https://github.com/confluentinc/kafka-connect-hdfs
> >
> >
> >
> >
> >
> > On 7/12/17, 8:27 AM, "Debasish Ghosh"  wrote:
> >
> > Hi -
> >
> > I would like to use the embedded API of Kafka Connect as per
> > https://cwiki.apache.org/confluence/pages/viewpage.
> > action?pageId=58851767.
> > But cannot find enough details regarding the APIs and implementation
> > models. Is there any sample example that gives enough details about
> > embedded Kafka Connect APIs ?
> >
> > My use case is as follows :-
> >
> > I have a Kafka Streams app from which I plan to use a HDFS sink
> > connector
> > to write to HDFS. And plan to use embedded Kafka Connect API.
> >
> > regards.
> >
> > --
> > Debasish Ghosh
> > http://manning.com/ghosh2
> > http://manning.com/ghosh
> >
> > Twttr: @debasishg
> > Blog: http://debasishg.blogspot.com
> > Code: http://github.com/debasishg
> >
> >
> >
>
>
> --
> Debasish Ghosh
> http://manning.com/ghosh2
> http://manning.com/ghosh
>
> Twttr: @debasishg
> Blog: http://debasishg.blogspot.com
> Code: http://github.com/debasishg
>

Re: Kafka Connect Embedded API

[Debasish Ghosh]

Thanks .. I found this blog post from Confluent
https://www.confluent.io/blog/hello-world-kafka-connect-kafka-streams/ ..
It's possibly pre-KIP 26, as the code base says ..

/**
 * This is only a temporary extension to Kafka Connect runtime until there
is an Embedded API as per KIP-26
 */

Has KIP-26 been implemented as of 0.11 ? And do users use embedded Kafka
Connect ?

regards.

On Wed, Jul 12, 2017 at 8:51 PM, David Garcia  wrote:

> I would just look at an example:
>  https://github.com/confluentinc/kafka-connect-jdbc
> https://github.com/confluentinc/kafka-connect-hdfs
>
>
>
>
>
> On 7/12/17, 8:27 AM, "Debasish Ghosh"  wrote:
>
> Hi -
>
> I would like to use the embedded API of Kafka Connect as per
> https://cwiki.apache.org/confluence/pages/viewpage.
> action?pageId=58851767.
> But cannot find enough details regarding the APIs and implementation
> models. Is there any sample example that gives enough details about
> embedded Kafka Connect APIs ?
>
> My use case is as follows :-
>
> I have a Kafka Streams app from which I plan to use a HDFS sink
> connector
> to write to HDFS. And plan to use embedded Kafka Connect API.
>
> regards.
>
> --
> Debasish Ghosh
> http://manning.com/ghosh2
> http://manning.com/ghosh
>
> Twttr: @debasishg
> Blog: http://debasishg.blogspot.com
> Code: http://github.com/debasishg
>
>
>


-- 
Debasish Ghosh
http://manning.com/ghosh2
http://manning.com/ghosh

Twttr: @debasishg
Blog: http://debasishg.blogspot.com
Code: http://github.com/debasishg

Re: Kafka Connect Embedded API

[David Garcia]

I would just look at an example:
 https://github.com/confluentinc/kafka-connect-jdbc
https://github.com/confluentinc/kafka-connect-hdfs





On 7/12/17, 8:27 AM, "Debasish Ghosh"  wrote:

Hi -

I would like to use the embedded API of Kafka Connect as per
https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=58851767.
But cannot find enough details regarding the APIs and implementation
models. Is there any sample example that gives enough details about
embedded Kafka Connect APIs ?

My use case is as follows :-

I have a Kafka Streams app from which I plan to use a HDFS sink connector
to write to HDFS. And plan to use embedded Kafka Connect API.

regards.

-- 
Debasish Ghosh
http://manning.com/ghosh2
http://manning.com/ghosh

Twttr: @debasishg
Blog: http://debasishg.blogspot.com
Code: http://github.com/debasishg

Kafka Connect Embedded API

[Debasish Ghosh]

Hi -

I would like to use the embedded API of Kafka Connect as per
https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=58851767.
But cannot find enough details regarding the APIs and implementation
models. Is there any sample example that gives enough details about
embedded Kafka Connect APIs ?

My use case is as follows :-

I have a Kafka Streams app from which I plan to use a HDFS sink connector
to write to HDFS. And plan to use embedded Kafka Connect API.

regards.

-- 
Debasish Ghosh
http://manning.com/ghosh2
http://manning.com/ghosh

Twttr: @debasishg
Blog: http://debasishg.blogspot.com
Code: http://github.com/debasishg

Kafka Connect Embedded API

[Shiti Saxena]

Hi,

I wanted to use Kafka Connect in an application and wanted to if the
Embedded API discussed in KIP-26

available
in 0.9.0.0 or is there an alternative?

Thanks,
Shiti