[
https://issues.apache.org/jira/browse/HIVE-4756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13690493#comment-13690493
]
Brock Noland commented on HIVE-4756:
------------------------------------
OK, I think figured it out. I develop on a RH6.3 host and our internal parallel
test environment is also RH6.3. The failures I pasted above were from the
parallel test environment. As they failed locally I thought this was ubiquitous.
Long story short, it this looks to be caused by YARN memory limits in
additional to glibc's new per-thread arena allocator. Setting the environment
variable MALLOC_ARENA_MAX=4 before starting the test fixes the failures.
Therefore the fix could be to patch our testutils/hadoop script similar to
HADOOP-7154 or to upgrade to 2.0.4-alpha (or 5) since for MiniMR they stopped
limiting memory in MAPREDUCE-5094.
I am fine with either but unless there is known issues with a new version of
Hadoop I'd prefer that approach for dogfooding purposes.
> Upgrade Hadoop 0.23 profile to 2.0.5-alpha
> ------------------------------------------
>
> Key: HIVE-4756
> URL: https://issues.apache.org/jira/browse/HIVE-4756
> Project: Hive
> Issue Type: Sub-task
> Reporter: Brock Noland
> Assignee: Brock Noland
> Fix For: 0.12.0
>
> Attachments: HIVE-4756.patch
>
>
> The minimr tests fail at present with the 0.23 profile. In my tests upgrading
> to 2.0.5-alpha fixes this.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
