HI, Total memory of cluster is 16G*40 = 640GB, total size of data file is 600/1024GB*60 = 35GB, so I suggest to load all data files(60 days) once.
BTW, if loading small data file(total size) for each data loading, it will generate small carbon files. You can add "carbon.enable.auto.load.merge=true" to carbon.properties file to enable compaction feature. -- View this message in context: http://apache-carbondata-mailing-list-archive.1130556.n5.nabble.com/how-to-make-carbon-run-faster-tp5305p5427.html Sent from the Apache CarbonData Mailing List archive mailing list archive at Nabble.com.
