Hi Team, Learned about apache drill that - 'Drill is memory intensive and therefore requires sufficient memory to run optimally. You can modify how much memory that you want allocated to Drill. Drill typically performs better with as much memory as possible.'
With this I tried allocating as much as memory I could for drill to run. I'm running the drill on my local machine so configured the JAVA_TOOL_OPTIONS to 8GB as Environment variable. Which in turn increased the heap memory. [cid:[email protected]] While running a query for generating a parquet file from SQL Server having millions of record, the drill just uses 3 - 4 % of heap memory. Any ways there is no increase in the performance(reduce in time of file generation). Can you please let us know if there's a way to reduce the file generation time? [cid:[email protected]] Please let me know if any further details are required. Looking for your reply to Vishwajeet Anantvilas SONUNE <[email protected]> Thanks Vishwajeet Sonune ******************************************************************* This e-mail is confidential. It may also be legally privileged. If you are not the addressee you may not copy, forward, disclose or use any part of it. If you have received this message in error, please delete it and all copies from your system and notify the sender immediately by return e-mail. Internet communications cannot be guaranteed to be timely, secure, error or virus-free. The sender does not accept liability for any errors or omissions. ******************************************************************* "SAVE PAPER - THINK BEFORE YOU PRINT!"
