[ https://issues.apache.org/jira/browse/HIVE-2428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Phabricator updated HIVE-2428: ------------------------------ Attachment: HIVE-2428.D2121.1.patch kevinwilfong requested code review of "HIVE-2428 [jira] ADD ARCHIVE has no effect when query runs in local mode". Reviewers: JIRA https://issues.apache.org/jira/browse/HIVE-2428 Added the -archives flag to the command run when a map reduce task is run locally. It runs essentially exactly as it does for the -files flag. This fixes the issue, I have added a test to verify that. When you ADD ARCHIVE a file and the query runs in local mode, the file is not available at all. For example running the commands echo '#!/bin/bash\nls -l 1>&2;read' > foo.sh hive -e 'ADD FILE foo.sh; ADD ARCHIVE /tmp/mapreduce_test.zip; SELECT TRANSFORM USING "sh foo.sh" FROM src' when the query is allowed to run in local mode, only information for foo.sh is returned. However, if the query is not allowed to run in local mode, information for both foo.sh and mapreduce_test.zip is returned. TEST PLAN EMPTY REVISION DETAIL https://reviews.facebook.net/D2121 AFFECTED FILES data/files/add_archive_local.zip data/scripts/add_archive_local_script ql/src/test/results/clientpositive/add_archive_local.q.out ql/src/test/queries/clientpositive/add_archive_local.q ql/src/java/org/apache/hadoop/hive/ql/exec/MapRedTask.java MANAGE HERALD DIFFERENTIAL RULES https://reviews.facebook.net/herald/view/differential/ WHY DID I GET THIS EMAIL? https://reviews.facebook.net/herald/transcript/4599/ Tip: use the X-Herald-Rules header to filter Herald messages in your client. > ADD ARCHIVE has no effect when query runs in local mode > ------------------------------------------------------- > > Key: HIVE-2428 > URL: https://issues.apache.org/jira/browse/HIVE-2428 > Project: Hive > Issue Type: Bug > Reporter: Kevin Wilfong > Assignee: Kevin Wilfong > Attachments: HIVE-2428.1.patch.txt, HIVE-2428.D2121.1.patch > > > When you ADD ARCHIVE a file and the query runs in local mode, the file is not > available at all. > For example running the commands > echo '#!/bin/bash\nls -l 1>&2;read' > foo.sh > hive -e 'ADD FILE foo.sh; ADD ARCHIVE /tmp/mapreduce_test.zip; SELECT > TRANSFORM(*) USING "sh foo.sh" FROM src' > when the query is allowed to run in local mode, only information for foo.sh > is returned. > However, if the query is not allowed to run in local mode, information for > both foo.sh and mapreduce_test.zip is returned. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira