[ 
https://issues.apache.org/jira/browse/CRUNCH-606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Micah Whitacre updated CRUNCH-606:
----------------------------------
    Attachment: CRUNCH-606-final.patch

Probably jinxing myself by labeling the patch final but here's the squashed 
patch with commit message I'd use to merge to master.

[~joshwills] does your +1 still stand?

> Create a KafkaSource
> --------------------
>
>                 Key: CRUNCH-606
>                 URL: https://issues.apache.org/jira/browse/CRUNCH-606
>             Project: Crunch
>          Issue Type: New Feature
>          Components: IO
>            Reporter: Micah Whitacre
>            Assignee: Micah Whitacre
>         Attachments: CRUNCH-606-byteswritable-singleuse.diff, 
> CRUNCH-606-byteswritable.diff, CRUNCH-606-final.patch, CRUNCH-606.diff, 
> CRUNCH-606.patch, CRUNCH-606b.diff
>
>
> Pulling data out of Kafka is a common use case and some of the ways to do it 
> Kafka Connect, Camus, Gobblin do not integrate nicely with existing 
> processing pipelines like Crunch.  With Kafka 0.9, the consuming API is a lot 
> easier so we should build a Source implementation that can read from Kafka.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to