[
https://issues.apache.org/jira/browse/HIVE-2428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Phabricator updated HIVE-2428:
------------------------------
Attachment: HIVE-2428.D2121.1.patch
kevinwilfong requested code review of "HIVE-2428 [jira] ADD ARCHIVE has no
effect when query runs in local mode".
Reviewers: JIRA
https://issues.apache.org/jira/browse/HIVE-2428
Added the -archives flag to the command run when a map reduce task is run
locally. It runs essentially exactly as it does for the -files flag. This
fixes the issue, I have added a test to verify that.
When you ADD ARCHIVE a file and the query runs in local mode, the file is not
available at all.
For example running the commands
echo '#!/bin/bash\nls -l 1>&2;read' > foo.sh
hive -e 'ADD FILE foo.sh; ADD ARCHIVE /tmp/mapreduce_test.zip; SELECT
TRANSFORM USING "sh foo.sh" FROM src'
when the query is allowed to run in local mode, only information for foo.sh
is returned.
However, if the query is not allowed to run in local mode, information for
both foo.sh and mapreduce_test.zip is returned.
TEST PLAN
EMPTY
REVISION DETAIL
https://reviews.facebook.net/D2121
AFFECTED FILES
data/files/add_archive_local.zip
data/scripts/add_archive_local_script
ql/src/test/results/clientpositive/add_archive_local.q.out
ql/src/test/queries/clientpositive/add_archive_local.q
ql/src/java/org/apache/hadoop/hive/ql/exec/MapRedTask.java
MANAGE HERALD DIFFERENTIAL RULES
https://reviews.facebook.net/herald/view/differential/
WHY DID I GET THIS EMAIL?
https://reviews.facebook.net/herald/transcript/4599/
Tip: use the X-Herald-Rules header to filter Herald messages in your client.
> ADD ARCHIVE has no effect when query runs in local mode
> -------------------------------------------------------
>
> Key: HIVE-2428
> URL: https://issues.apache.org/jira/browse/HIVE-2428
> Project: Hive
> Issue Type: Bug
> Reporter: Kevin Wilfong
> Assignee: Kevin Wilfong
> Attachments: HIVE-2428.1.patch.txt, HIVE-2428.D2121.1.patch
>
>
> When you ADD ARCHIVE a file and the query runs in local mode, the file is not
> available at all.
> For example running the commands
> echo '#!/bin/bash\nls -l 1>&2;read' > foo.sh
> hive -e 'ADD FILE foo.sh; ADD ARCHIVE /tmp/mapreduce_test.zip; SELECT
> TRANSFORM(*) USING "sh foo.sh" FROM src'
> when the query is allowed to run in local mode, only information for foo.sh
> is returned.
> However, if the query is not allowed to run in local mode, information for
> both foo.sh and mapreduce_test.zip is returned.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
