[
https://issues.apache.org/jira/browse/PARQUET-340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Julien Le Dem resolved PARQUET-340.
-----------------------------------
Resolution: Fixed
Fix Version/s: 2.0.0
Issue resolved by pull request 246
[https://github.com/apache/parquet-mr/pull/246]
> totalMemoryPool is truncated to 32 bits
> ---------------------------------------
>
> Key: PARQUET-340
> URL: https://issues.apache.org/jira/browse/PARQUET-340
> Project: Parquet
> Issue Type: Bug
> Reporter: Chris Bannister
> Fix For: 2.0.0
>
>
> with heap set to 50gb seeings lots of errors like this
> Jul 17, 2015 3:18:14 PM WARNING: org.apache.parquet.hadoop.MemoryManager:
> Total allocation exceeds 95.00% (2,147,483,647 bytes) of heap memory
> this is because the ratio passed into calculate the total memory is a float
> which when used is causing the long value to be truncate to max int32.
> Fix this by making it a double instead
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)