[
https://issues.apache.org/jira/browse/PIG-2143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13055250#comment-13055250
]
Dmitriy V. Ryaboy commented on PIG-2143:
----------------------------------------
In order to make this kind of thing work as more and more options are added, I
suggest we add a single optional second argument, which specifies all the flags
/ options, similar to how we did it in HBaseStorage.
So the invocation would be something like this:
{code}
store mystuff into 'myplace' using PigStorage('|', '-compress=lzo -storeSchema
-overwrite');
{code}
> Improvements for PigStorage
> ---------------------------
>
> Key: PIG-2143
> URL: https://issues.apache.org/jira/browse/PIG-2143
> Project: Pig
> Issue Type: Improvement
> Reporter: Dmitriy V. Ryaboy
>
> I'd like to propose that we allow for a greater degree of customization in
> PigStorage.
> An incomplete list features that we might want to add:
> - flag to tell it to overwrite existing output if it exists
> - flag to tell it to compress output using gzip|bzip|lzo (currently this can
> be achieved by setting the directory name to end in .gz or .bz2, which is a
> bit awkward)
> - flag to tell it to store the schema and header (perhaps by merging in
> PigStorageSchema work?)
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
