ajantha-bhat commented on pull request #3988: URL: https://github.com/apache/carbondata/pull/3988#issuecomment-763291142
@QiangCai : Sending all index file info from executor to driver will bring serialization overhead? will it slowdown the load performance ? Also can the executors write directly into merge index file ? But If we acquire lock, I am afraid it will also slow down the load speed. Any idea which approach can be better ? ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org