My model have 7 tables,a cube have 15 dimensions, in the “Convert Cuboid
Data to HFile” step to start too many maps and reduces(maps 500+,reduces 1.
4k+),This step expend all resources of the small cluster.

I set these parameters in the cluster:

dfs.block.size=256M

hive.exec.reducers.bytes.per.reducer=1073741824

hive.merge.mapfiles=true

hive.merge.mapredfiles=true

hive.merge.size.per.task=256M

 

kylin_hive_conf.xml this file uses the default settings

Where can I turning performance optimization?

Thanks.

Reply via email to