How to speed up reading from file?
Hello, Is there an optimal number of partitions per number of rows, when writing into disk, so we can re-read later from source in a distributed way? Any thoughts? Thanks Saif
Re: How to speed up reading from file?
Hi, Saif, The optimal number of rows per partition depends on many factors, right? for example, your row size, your file system configuration, your replication configuration and the performance of your underlying hardware. The best way is to do the performance testing and tuning your