Correction - it looks like the query uses \u002 to separate array elements
and \u001 to separate the other fields. The question is still similar
though in wondering how I can load that array into pig.
Note - If my data is formatted as a tsv with parentheses surrounding the
array:
(element1,element2,element3) anotherfield
This loads properly when I use LOAD '/my/tsvfile' USING PigStorage('\t') AS
(elements:tuple(),afield:chararray);
On Fri, Mar 21, 2014 at 8:38 AM, Jeff Storey <storey.j...@gmail.com> wrote:
> I'm executing a hive query in which one of the fields an array and writing
> it to a file using:
>
> INSERT OVERWRITE '/path/to/output' SELECT ...
>
> This query works well. I would like to load this data into pig, but I'm
> quite sure how to get the array properly into pig.
>
> My output file from the query doesn't look like it has any array notation
> when using the default ^A separator.
>
> Is there a way I can execute a query with an array field output that can
> then be directly loaded into pig as a tuple?
>
> Thank you.
>
