Re: Avro large binary read memory problem

2019-07-23 Thread Nicolas Paris
On Tue, Jul 23, 2019 at 05:10:19PM +, Mario Amatucci wrote: > https://spark.apache.org/docs/2.2.0/configuration.html#memory-management thanks for the pointer, however, I tried almost every configuration and the behavior tends to show that spark keeps things in memory instead of releasing it

RE: Avro large binary read memory problem

2019-07-23 Thread Mario Amatucci
https://spark.apache.org/docs/2.2.0/configuration.html#memory-management MARIO AMATUCCI Senior Software Engineer   Office: +48 12 881 10 05 x 31463   Email: mario_amatu...@epam.com Gdansk, Poland   epam.com   ~do more with less~   CONFIDENTIALITY CAUTION AND DISCLAIMER This message is