GitHub user timrobertson100 opened a pull request:
https://github.com/apache/hive/pull/74
HIVE-13539: HiveHFileOutputFormat searching the wrong directory for Hâ¦
I believe this is a fix for https://issues.apache.org/jira/browse/HIVE-13539
When there are several reducers (or speculative execution) there becomes
multiple output dircetories for the task attempts. Previous behaviour threw
exception incorrectly as it assumed multiple HFiles.
Here, I am attempting to start the descending directory search from the
task attempt folder and not from the higher directory for the table.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/timrobertson100/hive master
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/hive/pull/74.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #74
----
commit a4abe6bec0c0141bddcbfa75408b49123af65066
Author: timrobertson100 <[email protected]>
Date: 2016-04-20T13:23:24Z
HIVE-13539: HiveHFileOutputFormat searching the wrong directory for HFiles
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
