Need help in kafka hdfs connector

2018-03-29 Thread Santosh Kumar J P
Hi,

Do we have any other Kafka HDFS connectors implementation other than
Confluent HDFS connector.

Thank you,
Regards,
Santosh


Need help in distributing large files using kafka

2017-12-05 Thread Santosh Kumar J P
Hi,

We are using Kafka to distribute content to multiple clients where each
individual client will have unique group-id. We have a requirement of
distributing 25MB files to each clients. Following are the some of the
issue I feel I may face.

1.  If too many clients ( 1 devices) try to connect to Kafka for
fetching 25MB of multiple files, there could be connectivity issue with
Kafka server
2. Network bandwidth issue may occur as too many clients try to fetch data
from Kafka.

Please let me know your suggestion.

Thanks,
Santosh


Can we restrict number of connection/consumer to kafka topic partition

2017-12-05 Thread Santosh Kumar J P
Hi,

Can we restrict number of consumer groups to subscribe to a Kafka topic
partition.

Thanks,
Santosh