Dmitriy V. Ryaboy created PIG-2925:
--------------------------------------

             Summary: Extremely long JobConf values should not be added to 
Streaming environment
                 Key: PIG-2925
                 URL: https://issues.apache.org/jira/browse/PIG-2925
             Project: Pig
          Issue Type: Bug
            Reporter: Dmitriy V. Ryaboy


PIG-2900 made Pig match Hadoop's practice of making all JobConf properties 
available as environment variables for pig streaming. 

As it happens, ProcessBuilder creates a long string with all environment 
variables and their values on it, then runs it; having some of the weightier 
properties like serialized plans in the environment can make the total command 
length exceed OS limits. 

We propose adding a blacklist of properties which should not be added to 
streaming environment.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Reply via email to