what are common ways to convert info on a web site into a log entry?

2018-01-15 Thread James Smyth
Hi Kafka people, I am very new to kafka, so perhaps my question is naive. I spent some time searching around at resources of kafka but only became more confused. What are common ways to pull info from a web site and send to kafka to become a log entry? There is a web site that I want to pull a

Re: what are common ways to convert info on a web site into a log entry?

2018-01-15 Thread James Smyth
nd dirty solution you could put a script using curl in cron to pull the > web content and write it to a topic using the kafka-rest-proxy. > > On Mon, Jan 15, 2018 at 1:52 PM James Smyth <smyth.james...@gmail.com> > wrote: > >> Hi Kafka people, >> >> I am ver

what are common ways to convert info on a web site into a log entry?

2018-01-15 Thread James Smyth
Hi Kafka people, I am very new to kafka, so perhaps my question is naive. I spent some time searching around at resources of kafka but only became more confused. What are common ways to pull info from a web site and send to kafka to become a log entry? There is a web site that I want to pull a