Re: Kafka producer iOS and android

[cac...@gmail.com]

I may be out of date, but I believe security measures are only in the
proposal stage. Your use case most likely involves sending data from the
internet at large to the Kafka instance. This will result in all data sent
to the Kafka instance being consumable by the internet at large. This is
unlikely to be what you desire and would likely be a disservice to your
users.  Using a REST wrapper (I believe there is at least one available)
will limit the internet at large to producing data and you can build
additional authentication mechanisms into that if desired.

I hope someone else will correct me if I am mistaken.

Christian

On Mon, Oct 20, 2014 at 10:28 AM, Josh J  wrote:

> >> What is the use case requiring that?
>
> I'm looking for an open source library that I can use in Android and iOS,
> instead of hand rolling my own.
>
> On Mon, Oct 20, 2014 at 10:21 AM, Joe Stein  wrote:
>
> > What is the use case requiring that? If you try to integrate kafka in the
> > two different mobile platforms you will get many separate development
> > cycles and none will work in many mobile networked environments. You can
> > HTTP/HTTPS POST the same Avro objects (or Thrift or ProtoBuf) from each
> > platform. You also then have 1 integration cycle then easily maintained
> and
> > supported cohesively over all.  The Avro/Thrift/ProtoBuf objects and a
> > HTTP/HTTPS layer, thats it. Wrapping the producer is pretty straight
> > forward in any language now a days I think and it depends what language
> and
> > how you operate production services to pick how to write that producer.
> > That producer and interface should change much and you have to think a
> > little about configurations but most all of that is server side depending
> > on the message.
> >
> > /***
> >  Joe Stein
> >  Founder, Principal Consultant
> >  Big Data Open Source Security LLC
> >  http://www.stealth.ly
> >  Twitter: @allthingshadoop 
> > /
> >
> > On Mon, Oct 20, 2014 at 1:09 PM, Josh J  wrote:
> >
> > > Thanks for the tip. I would like to avoid hand rolling any code if
> > > possible. For example, on Android I would like to ask if people are
> able
> > to
> > > include and use the kafka jars with no problem? And on iOS, if there
> is a
> > > way to include any C or other relevant code.
> > >
> > > On Mon, Oct 20, 2014 at 8:49 AM, Harsha  wrote:
> > >
> > > >
> > > > Hi Josh,
> > > >  Why not have Rest api service running where you post
> messages
> > > >  from your mobile clients. Rest api can run kafka producers
> > > >  accepting these messages pushing it into kafka brokers.
> Here
> > > >  is an example where we did similar service for kafka
> > > >  https://github.com/mozilla-metrics/bagheera . This project
> > used
> > > >  kafka 0.7 but you can see how its implemented. Hope that
> > helps.
> > > > -Harsha
> > > > On Mon, Oct 20, 2014, at 08:45 AM, Josh J wrote:
> > > > > hi
> > > > >
> > > > > Is it possible to have iOS and android to run the code needed for
> > Kafka
> > > > > producers ? I want to have mobile clients connect to Kafka broker
> > > > >
> > > > > Thanks,
> > > > > Josh
> > > >
> > >
> >
>

Re: Kafka producer iOS and android

[Josh J]

>> What is the use case requiring that?

I'm looking for an open source library that I can use in Android and iOS,
instead of hand rolling my own.

On Mon, Oct 20, 2014 at 10:21 AM, Joe Stein  wrote:

> What is the use case requiring that? If you try to integrate kafka in the
> two different mobile platforms you will get many separate development
> cycles and none will work in many mobile networked environments. You can
> HTTP/HTTPS POST the same Avro objects (or Thrift or ProtoBuf) from each
> platform. You also then have 1 integration cycle then easily maintained and
> supported cohesively over all.  The Avro/Thrift/ProtoBuf objects and a
> HTTP/HTTPS layer, thats it. Wrapping the producer is pretty straight
> forward in any language now a days I think and it depends what language and
> how you operate production services to pick how to write that producer.
> That producer and interface should change much and you have to think a
> little about configurations but most all of that is server side depending
> on the message.
>
> /***
>  Joe Stein
>  Founder, Principal Consultant
>  Big Data Open Source Security LLC
>  http://www.stealth.ly
>  Twitter: @allthingshadoop 
> /
>
> On Mon, Oct 20, 2014 at 1:09 PM, Josh J  wrote:
>
> > Thanks for the tip. I would like to avoid hand rolling any code if
> > possible. For example, on Android I would like to ask if people are able
> to
> > include and use the kafka jars with no problem? And on iOS, if there is a
> > way to include any C or other relevant code.
> >
> > On Mon, Oct 20, 2014 at 8:49 AM, Harsha  wrote:
> >
> > >
> > > Hi Josh,
> > >  Why not have Rest api service running where you post messages
> > >  from your mobile clients. Rest api can run kafka producers
> > >  accepting these messages pushing it into kafka brokers.  Here
> > >  is an example where we did similar service for kafka
> > >  https://github.com/mozilla-metrics/bagheera . This project
> used
> > >  kafka 0.7 but you can see how its implemented. Hope that
> helps.
> > > -Harsha
> > > On Mon, Oct 20, 2014, at 08:45 AM, Josh J wrote:
> > > > hi
> > > >
> > > > Is it possible to have iOS and android to run the code needed for
> Kafka
> > > > producers ? I want to have mobile clients connect to Kafka broker
> > > >
> > > > Thanks,
> > > > Josh
> > >
> >
>

Re: Kafka producer iOS and android

[Joe Stein]

What is the use case requiring that? If you try to integrate kafka in the
two different mobile platforms you will get many separate development
cycles and none will work in many mobile networked environments. You can
HTTP/HTTPS POST the same Avro objects (or Thrift or ProtoBuf) from each
platform. You also then have 1 integration cycle then easily maintained and
supported cohesively over all.  The Avro/Thrift/ProtoBuf objects and a
HTTP/HTTPS layer, thats it. Wrapping the producer is pretty straight
forward in any language now a days I think and it depends what language and
how you operate production services to pick how to write that producer.
That producer and interface should change much and you have to think a
little about configurations but most all of that is server side depending
on the message.

/***
 Joe Stein
 Founder, Principal Consultant
 Big Data Open Source Security LLC
 http://www.stealth.ly
 Twitter: @allthingshadoop 
/

On Mon, Oct 20, 2014 at 1:09 PM, Josh J  wrote:

> Thanks for the tip. I would like to avoid hand rolling any code if
> possible. For example, on Android I would like to ask if people are able to
> include and use the kafka jars with no problem? And on iOS, if there is a
> way to include any C or other relevant code.
>
> On Mon, Oct 20, 2014 at 8:49 AM, Harsha  wrote:
>
> >
> > Hi Josh,
> >  Why not have Rest api service running where you post messages
> >  from your mobile clients. Rest api can run kafka producers
> >  accepting these messages pushing it into kafka brokers.  Here
> >  is an example where we did similar service for kafka
> >  https://github.com/mozilla-metrics/bagheera . This project used
> >  kafka 0.7 but you can see how its implemented. Hope that helps.
> > -Harsha
> > On Mon, Oct 20, 2014, at 08:45 AM, Josh J wrote:
> > > hi
> > >
> > > Is it possible to have iOS and android to run the code needed for Kafka
> > > producers ? I want to have mobile clients connect to Kafka broker
> > >
> > > Thanks,
> > > Josh
> >
>

Re: Kafka producer iOS and android

[Josh J]

Thanks for the tip. I would like to avoid hand rolling any code if
possible. For example, on Android I would like to ask if people are able to
include and use the kafka jars with no problem? And on iOS, if there is a
way to include any C or other relevant code.

On Mon, Oct 20, 2014 at 8:49 AM, Harsha  wrote:

>
> Hi Josh,
>  Why not have Rest api service running where you post messages
>  from your mobile clients. Rest api can run kafka producers
>  accepting these messages pushing it into kafka brokers.  Here
>  is an example where we did similar service for kafka
>  https://github.com/mozilla-metrics/bagheera . This project used
>  kafka 0.7 but you can see how its implemented. Hope that helps.
> -Harsha
> On Mon, Oct 20, 2014, at 08:45 AM, Josh J wrote:
> > hi
> >
> > Is it possible to have iOS and android to run the code needed for Kafka
> > producers ? I want to have mobile clients connect to Kafka broker
> >
> > Thanks,
> > Josh
>

Re: Kafka producer iOS and android

[Harsha]

Hi Josh,
 Why not have Rest api service running where you post messages
 from your mobile clients. Rest api can run kafka producers
 accepting these messages pushing it into kafka brokers.  Here
 is an example where we did similar service for kafka 
 https://github.com/mozilla-metrics/bagheera . This project used
 kafka 0.7 but you can see how its implemented. Hope that helps.
-Harsha
On Mon, Oct 20, 2014, at 08:45 AM, Josh J wrote:
> hi
> 
> Is it possible to have iOS and android to run the code needed for Kafka
> producers ? I want to have mobile clients connect to Kafka broker
> 
> Thanks,
> Josh

Kafka producer iOS and android

[Josh J]

hi

Is it possible to have iOS and android to run the code needed for Kafka
producers ? I want to have mobile clients connect to Kafka broker

Thanks,
Josh