When doing dynamic partitioning, Hive needs to look at each record and determine which partition to place it in. In the case where all records go to the same partition, it is more efficient to tell Hive up front, that is, to use static partitioning. So you can use dynamic partition for large files, it will just take more processing power and time.
Alan. On Tue, Jan 2, 2018 at 5:53 PM, Sachit Murarka <connectsac...@gmail.com> wrote: > Hi, > > I am unclear about Dynamic and static partition. > > 1. Why static partition is good for loading large files and why can’t > we use dynamic partition for the same? > 2. Why does dynamic partition take more time in loading data than > static partitions? > > Also please explain when to use strict and nonstrict mode. > > Kind Regards, > Sachit Murarka >
