Hi Abhimanya, You can very well do it through Kafka, KafkaStreams and something like redis.
I would design it to be something like this:- 1. Topic 1 - Pending tasks 2. Topic 2 - Reassigned Tasks. 3. Topic 3- Task To Resource Mapping. Some other components could be:- 4. Redis Hash(task progress info) We can also need to store a mapping of resources with completed task count and in progress task count. This shall help us in ensuring that pipeline remains active and bandwidth is managed between people who are free vs busy(managed through counts). 5. TaskAssigner - KStreams - listens to the Pending Tasks and Reassigned queue. sees who can be assigned task through reading redis hash. 6. Task Processor - java/scala program - processes the task.Probably trigged after resource processes the task. 7. Task rebalancer - java/scala program - triggered at timely intervals to do the reassignments. -Sameer. On Wed, Jun 21, 2017 at 7:55 AM, Tarun Garg <bigdat...@live.com> wrote: > need some more input on this. > > > Kafka is a queue it doesn't take any action. > > > sender(producer) sends data to kafka and consumer pulls data from kafka > queue. so there is no assignment of data to any consumer. > > if a process/human cann't take any action then kafka cann't help in this > case. > > hope it answers. > > ________________________________ > From: Abhimanyu Nagrath <abhimanyunagr...@gmail.com> > Sent: Monday, June 19, 2017 8:01 PM > To: users@kafka.apache.org > Subject: Re: ticketing system Design > > Hi , > > Can anyone suggest me where I can get the answer for these type of > questions? > > > Regards, > Abhimanyu > > On Thu, Jun 8, 2017 at 6:49 PM, Abhimanyu Nagrath < > abhimanyunagr...@gmail.com> wrote: > > > Hi , > > > > Is Apache Kafka along with storm can be used to design a ticketing > system. > > By ticketing system, I mean that there are millions of tasks stored in > > Kafka queues and there are processes/humans to take some actions on the > > task. there are come constraints that same task should not be assigned to > > two processes/humans and if a task flows to a process/human and no action > > is performed it should be reassigned. > > I am not sure whether this can be solved using Kafka.Any help is > > appreciated > > > > > > > > Regards, > > Abhimanyu > > >
