[ 
https://issues.apache.org/jira/browse/CRUNCH-635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16878108#comment-16878108
 ] 

Josh Wills commented on CRUNCH-635:
-----------------------------------

Re: multiple writers, leave it as-is for now; Spark uses the multiple writers 
approach and suffers from the resulting memory overhead. This is simpler and 
works fine, IMO.

> MultipleOutput Text Targets
> ---------------------------
>
>                 Key: CRUNCH-635
>                 URL: https://issues.apache.org/jira/browse/CRUNCH-635
>             Project: Crunch
>          Issue Type: Improvement
>          Components: IO
>            Reporter: Jim McStanton
>            Priority: Minor
>         Attachments: CRUNCH-635.patch, CRUNCH-635_1.patch
>
>
> CRUNCH-306 was logged to add the ability to write an output file per key in a 
> PTable. The original issue covers just Avro output files, this Improvement 
> would extend this by adding support for Text file targets. 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Reply via email to