Illya Yalovyy created OOZIE-2402: ------------------------------------ Summary: oozie-setup.sh sharelib create takes a long time on large clusters Key: OOZIE-2402 URL: https://issues.apache.org/jira/browse/OOZIE-2402 Project: Oozie Issue Type: Improvement Components: tools Affects Versions: 4.2.0 Reporter: Illya Yalovyy
When cluster has 256+ nodes it can take up to 5 minutes to create a sharelib. Copy the tarball itself takes only around 10 seconds. It seems like performance could be improved by loading files concurrently in many threads. -- This message was sent by Atlassian JIRA (v6.3.4#6332)