[
https://issues.apache.org/jira/browse/PIG-2242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ashutosh Chauhan reassigned PIG-2242:
-------------------------------------
Assignee: Mark Roddy
Assigning to Mark.
+1 on patch.
It will be good to have an end-to-end test for this as this is a new
functionality. Alan is doing some good work building testing infrastructure
using which adding such tests will be easy. Since, instructions on how to do
that is not ready yet, I will open a followup jira for it.
Running test-commit now and will commit if it passes.
> Allow the delimiter to be specified when calling TOKENIZE
> ---------------------------------------------------------
>
> Key: PIG-2242
> URL: https://issues.apache.org/jira/browse/PIG-2242
> Project: Pig
> Issue Type: Improvement
> Components: impl
> Affects Versions: 0.8.1, 0.9.0
> Reporter: Mark Roddy
> Assignee: Mark Roddy
> Priority: Minor
> Fix For: 0.10
>
> Attachments: tokendelim.diff
>
>
> The TOKENIZE function is a wrapper around the Java StringTokenizer class.
> The delimiter argument is currently hard coded as " \",()*", and it is
> impossible to specify an alternative delimiter.
> The delimiter can be added as an optional argument to TOKENIZE which will
> preserve backwards compatibility while allowing users to specify their own
> delimiter chars.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
