[
https://issues.apache.org/jira/browse/ARROW-1795?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16251275#comment-16251275
]
ASF GitHub Bot commented on ARROW-1795:
---------------------------------------
luchy0120 commented on issue #1303: ARROW-1795: [Plasma] Change evict policy
URL: https://github.com/apache/arrow/pull/1303#issuecomment-344233736
@robertnishihara , I don't have much knowledge about the design and I can't
see the whole picture. What I care about is whether plasma will crash if I put
it into production and read/write data 1000 times. I'm trying to bring plasma
to our project . So I want to make sure it will not crash . I don't think it is
reasonable that if I put data smaller than the initialized amount ,it will
throw exception saying out-of-memory. As I don't see any doc talking about
eviction or should I evict data myself , sometimes I
need to check some source code in order to get some knowledge on my own. I
didn't receive feedback
of my issue https://issues.apache.org/jira/projects/ARROW/issues/ARROW-1792
so I search the error and
try to figure out the reason. I've been working on this for several weeks
so emotionally I want plasma to be more stable and more welcoming.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
> [Plasma C++] change evict policy
> --------------------------------
>
> Key: ARROW-1795
> URL: https://issues.apache.org/jira/browse/ARROW-1795
> Project: Apache Arrow
> Issue Type: Improvement
> Components: Plasma (C++)
> Reporter: Lu Qi
> Assignee: Lu Qi
> Priority: Minor
> Labels: pull-request-available
>
> case 1.say, we have total free memory 8 G , we have input 5G data, then comes
> another 6G data,
> if we choose to evict space 6G , it will throw exception saying that
> no object can be free. This is because we didn't count the 3G remaining free
> space .If we count this remaining 3G , we need to ask only 3G,thus
> we can evict the 5G data and we are still alive .
> case 2. another situation is : if we have free memory 10G , we input 1.5G
> data ,then comes another
> 9G data , if we use 10*20% = 2G data to evict ,then we will crash . In this
> situation we need to
> use 9+1.5-10 = 0.5G data to evict
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
