Re: cache OS memory and spark usage of it

2018-04-11 Thread Jose Raul Perez Rodriguez
it was helpful, Then, the OS needs to fill some pressure from the applications requesting memory to free some memory cache? Exactly under which circumstances the OS free that memory to give it to applications requesting it? I mean if the total memory is 16GB and 10GB are used for OS cache,

cache OS memory and spark usage of it

2018-04-10 Thread José Raúl Pérez Rodríguez
Hi, When I issue a "free -m" command in a host, I see a lot of memory used for cache in OS, however Spark Streaming is not able to request that memory for its usage, and it fail the execution due to not been able to launch executors. What I understand of the OS memory cache (the one in