Dmitriy V. Ryaboy created PIG-2925: -------------------------------------- Summary: Extremely long JobConf values should not be added to Streaming environment Key: PIG-2925 URL: https://issues.apache.org/jira/browse/PIG-2925 Project: Pig Issue Type: Bug Reporter: Dmitriy V. Ryaboy
PIG-2900 made Pig match Hadoop's practice of making all JobConf properties available as environment variables for pig streaming. As it happens, ProcessBuilder creates a long string with all environment variables and their values on it, then runs it; having some of the weightier properties like serialized plans in the environment can make the total command length exceed OS limits. We propose adding a blacklist of properties which should not be added to streaming environment. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira