The algorithm used is "layer", but why in-mem step while building the cube?

2018-08-27 Thread mvneethu
Hi, I have a confusion in the algorithms kylin has for different data. There are: 1. By Layer 2. Fast Cubing (MR) 3. Fast Cubing with spark >From what I have researched, fast cubing algorithm is the "in-mem" algorithm. Now, in my production, I am using "layer" cubing algorithm, but I see a step c

Re: The algorithm used is "layer", but why in-mem step while building the cube?

2018-08-27 Thread ShaoFeng Shi
Hi Neethu, You're correct that the fast cubing algorithm is also called "in-mem"; The algorithm in Spark is "by-layer", not fast cubing. On submitting a cubing job, Kylin pre-allocates steps for both "by-layer" and "in-mem"; But it only picks one to execute, the other one will be skipped. It mi

Re: The algorithm used is "layer", but why in-mem step while building the cube?

2018-08-27 Thread mvneethu
Thanks for the clarification. Thanks, Neethu -- Sent from: http://apache-kylin.74782.x6.nabble.com/