[
https://issues.apache.org/jira/browse/CRUNCH-362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14004860#comment-14004860
]
mac champion commented on CRUNCH-362:
-------------------------------------
There have been some questions around what exactly a "multiple-line CSV record"
might be. Just to clarify, this would be a valid example of a multi-line CSV
record:
{code}
"Champion, Mac","1234 Hoth St.
Apartment 101
Atlanta, GA
64086","30","M","5/28/2010 12:00:00 AM","Just some guy"
{code}
And this is the case that this code is specifically designed to handle.
> Add a CSV File Source
> ---------------------
>
> Key: CRUNCH-362
> URL: https://issues.apache.org/jira/browse/CRUNCH-362
> Project: Crunch
> Issue Type: Improvement
> Components: Core
> Affects Versions: 0.9.0
> Reporter: mac champion
> Assignee: mac champion
> Priority: Trivial
> Labels: csv, csvparser, inputformat
> Fix For: 0.10.0
>
> Attachments: 0001-CRUNCH-362-Add-CSVFileSource.patch,
> 0001-CRUNCH-362-Add-CSVFileSource.patch
>
> Original Estimate: 672h
> Remaining Estimate: 672h
>
> CSV files can be unpredictable. Among other quirks, it is possible for a
> single CSV record to span multiple lines in a file. In cases like these,
> TextFileSource is not effective and NLineFileSource is not flexible enough.
> The result of this JIRA should be a CSVFileSource which, at minimum, should
> be able to deal with multiple-line CSV records.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
