[
https://issues.apache.org/jira/browse/PIG-3548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13824148#comment-13824148
]
Alan Gates commented on PIG-3548:
---------------------------------
Could you store the parameters in a file rather than specify them on the
command line? See http://pig.apache.org/docs/r0.12.0/cont.html#Parameter-Sub
for details.
> Allow pig to load multiple paths specified in a filenames.txt
> -------------------------------------------------------------
>
> Key: PIG-3548
> URL: https://issues.apache.org/jira/browse/PIG-3548
> Project: Pig
> Issue Type: Improvement
> Reporter: Madhavi Nadig
>
> I have a list of paths stored in a filenames.txt. I would like to load them
> all using a single LOAD command. The paths don't conform to one or more
> regexes, so they have to specified individually.
> So far I've used the -param option with pig to specify them. But it results
> in an extremely long commandline and I'm afraid I wont be able to scale my
> script.
> shell : pig -param read_paths=<my-long-list-of-paths> something.pig
> something.pig : requests = LOAD '$read_paths' USING PigStorage(',');
--
This message was sent by Atlassian JIRA
(v6.1#6144)
