As in the demo cube "kylin_sales_cube", there are 18 dimensions and one agg with 15 dimensions. From executing "bin/kylin.sh org.apache.kylin.engine.mr.common.CubeStatsReader kylin_sales_cube", the base cuboid is also calated.
Statistics of kylin_sales_cube[20120101000000_20150101000000] > > >> Cube statistics hll precision: 14 > > Total cuboids: 161 > > Total estimated rows: 1540824 > > Total estimated size(MB): 25806.49935889244 > > Sampling percentage: 100 > > Mapper overlap ratio: 1.0 > > Mapper number: 0 > > Length of dimension MISTATS_KYLIN.KYLIN_SALES.BUYER_ID is 4 > > Length of dimension MISTATS_KYLIN.KYLIN_SALES.SELLER_ID is 4 > > Length of dimension MISTATS_KYLIN.KYLIN_SALES.TRANS_ID is 4 > > Length of dimension MISTATS_KYLIN.KYLIN_SALES.PART_DT is 3 > > Length of dimension MISTATS_KYLIN.KYLIN_SALES.LEAF_CATEG_ID is 1 > > Length of dimension MISTATS_KYLIN.KYLIN_CATEGORY_GROUPINGS.META_CATEG_NAME >> is 1 > > Length of dimension MISTATS_KYLIN.KYLIN_CATEGORY_GROUPINGS.CATEG_LVL2_NAME >> is 1 > > Length of dimension MISTATS_KYLIN.KYLIN_CATEGORY_GROUPINGS.CATEG_LVL3_NAME >> is 1 > > Length of dimension >> BUYER_ACCOUNT:MISTATS_KYLIN.KYLIN_ACCOUNT.ACCOUNT_BUYER_LEVEL is 1 > > Length of dimension >> SELLER_ACCOUNT:MISTATS_KYLIN.KYLIN_ACCOUNT.ACCOUNT_SELLER_LEVEL is 1 > > Length of dimension >> BUYER_ACCOUNT:MISTATS_KYLIN.KYLIN_ACCOUNT.ACCOUNT_COUNTRY is 1 > > Length of dimension >> SELLER_ACCOUNT:MISTATS_KYLIN.KYLIN_ACCOUNT.ACCOUNT_COUNTRY is 1 > > Length of dimension BUYER_COUNTRY:MISTATS_KYLIN.KYLIN_COUNTRY.NAME is 1 > > Length of dimension SELLER_COUNTRY:MISTATS_KYLIN.KYLIN_COUNTRY.NAME is 1 > > Length of dimension MISTATS_KYLIN.KYLIN_SALES.LSTG_FORMAT_NAME is 1 > > Length of dimension MISTATS_KYLIN.KYLIN_SALES.LSTG_SITE_ID is 1 > > Length of dimension MISTATS_KYLIN.KYLIN_SALES.OPS_USER_ID is 1 > > Length of dimension MISTATS_KYLIN.KYLIN_SALES.OPS_REGION is 1 > > |---- Cuboid 111111111111111111, est row: 10026, est MB: 167.97 > > |---- Cuboid 000111111111111111, est row: 9901, est MB: 165.84, >> shrink: 98.75% > > |---- Cuboid 000101111111111111, est row: 10039, est MB: 168.15, >> shrink: 101.39% > > |---- Cuboid 000101101111111111, est row: 10054, est MB: >> 168.4, shrink: 100.15% > > |---- Cuboid 000101001111111111, est row: 10037, est MB: >> 168.11, shrink: 99.83% > > |---- Cuboid 000100001111111111, est row: 9949, est >> MB: 166.64, shrink: 99.12% > > |---- Cuboid 000111110011111111, est row: 9934, est MB: 166.39, >> shrink: 100.33% > > |---- Cuboid 000101110011111111, est row: 10000, est MB: >> 167.49, shrink: 100.66% > > |---- Cuboid 000101100011111111, est row: 10028, est MB: >> 167.96, shrink: 100.28% > > |---- Cuboid 000101000011111111, est row: 10120, est >> MB: 169.5, shrink: 100.92% > > |---- Cuboid 000100000011111111, est row: 9897, >> est MB: 165.76, shrink: 97.8% > > |---- Cuboid 000111110001011111, est row: 10037, est MB: >> 168.11, shrink: 101.04% > > |---- Cuboid 000101110001011111, est row: 10006, est MB: >> 167.59, shrink: 99.69% > > |---- Cuboid 000101100001011111, est row: 10039, est >> MB: 168.14, shrink: 100.33% > > |---- Cuboid 000101000001011111, est row: 9991, >> est MB: 167.33, shrink: 99.52% > > |---- Cuboid 000100000001011111, est row: >> 9593, est MB: 160.67, shrink: 96.02% > > |---- Cuboid 000111110000001111, est row: 10030, est MB: >> 167.99, shrink: 99.93% > > |---- Cuboid 000101110000001111, est row: 9954, est >> MB: 166.71, shrink: 99.24% > > |---- Cuboid 000101100000001111, est row: 9925, >> est MB: 166.23, shrink: 99.71% > > |---- Cuboid 000101000000001111, est row: >> 9611, est MB: 160.96, shrink: 96.84% > > |---- Cuboid 000100000000001111, est row: >> 7045, est MB: 117.99, shrink: 73.3% > > |---- Cuboid 000111110000000011, est row: 9823, est >> MB: 164.52, shrink: 97.94% > > |---- Cuboid 000101110000000011, est row: 9799, >> est MB: 164.11, shrink: 99.76% > > |---- Cuboid 000101100000000011, est row: >> 9528, est MB: 159.57, shrink: 97.23% > > |---- Cuboid 000101000000000011, est row: >> 8496, est MB: 142.29, shrink: 89.17% > > |---- Cuboid 000100000000000011, est >> row: 2151, est MB: 36.02, shrink: 25.32% > > |---- Cuboid 000111110000000000, est row: 9404, >> est MB: 157.5, shrink: 95.73% > > |---- Cuboid 000101110000000000, est row: >> 9287, est MB: 155.53, shrink: 98.76% > > |---- Cuboid 000101100000000000, est row: >> 8808, est MB: 147.51, shrink: 94.84% > > |---- Cuboid 000101000000000000, est >> row: 6590, est MB: 110.36, shrink: 74.82% > > |---- Cuboid 000100000000000000, >> est row: 730, est MB: 12.23, shrink: 11.08% > > |---- Cuboid 000111110000001100, est row: 9863, est >> MB: 165.19, shrink: 98.33% > > |---- Cuboid 000101110000001100, est row: 9790, >> est MB: 163.96, shrink: 99.26% > > |---- Cuboid 000101100000001100, est row: >> 9706, est MB: 162.55, shrink: 99.14% > > |---- Cuboid 000101000000001100, est row: >> 9085, est MB: 152.15, shrink: 93.6% > > |---- Cuboid 000100000000001100, est >> row: 4293, est MB: 71.9, shrink: 47.25% > > |---- Cuboid 000111110001010011, est row: 10006, est MB: >> 167.59, shrink: 99.69% > > |---- Cuboid 000101110001010011, est row: 9901, est >> MB: 165.83, shrink: 98.95% > > |---- Cuboid 000101100001010011, est row: 9885, >> est MB: 165.56, shrink: 99.84% > > |---- Cuboid 000101000001010011, est row: >> 9866, est MB: 165.24, shrink: 99.81% > > |---- Cuboid 000100000001010011, est row: >> 7402, est MB: 123.97, shrink: 75.03% > > |---- Cuboid 000111110001010000, est row: 9956, est >> MB: 166.74, shrink: 99.5% > > |---- Cuboid 000101110001010000, est row: 9868, >> est MB: 165.27, shrink: 99.12% > > |---- Cuboid 000101100001010000, est row: >> 9846, est MB: 164.9, shrink: 99.78% > > |---- Cuboid 000101000001010000, est row: >> 9413, est MB: 157.64, shrink: 95.6% > > |---- Cuboid 000100000001010000, est >> row: 4396, est MB: 73.62, shrink: 46.7% > > |---- Cuboid 000111110001011100, est row: 10167, est MB: >> 170.28, shrink: 101.3% > > |---- Cuboid 000101110001011100, est row: 9978, est >> MB: 167.12, shrink: 98.14% > > |---- Cuboid 000101100001011100, est row: 9986, >> est MB: 167.25, shrink: 100.08% > > |---- Cuboid 000101000001011100, est row: >> 9850, est MB: 164.97, shrink: 98.64% > > |---- Cuboid 000100000001011100, est row: >> 8736, est MB: 146.31, shrink: 88.69% > > |---- Cuboid 000111110010101111, est row: 9956, est MB: >> 166.75, shrink: 100.22% > > |---- Cuboid 000101110010101111, est row: 9951, est MB: >> 166.67, shrink: 99.95% > > |---- Cuboid 000101100010101111, est row: 9947, est >> MB: 166.6, shrink: 99.96% > > |---- Cuboid 000101000010101111, est row: 9986, >> est MB: 167.25, shrink: 100.39% > > |---- Cuboid 000100000010101111, est row: >> 9498, est MB: 159.07, shrink: 95.11% > > |---- Cuboid 000111110010100011, est row: 9903, est MB: >> 165.86, shrink: 99.47% > > |---- Cuboid 000101110010100011, est row: 9962, est >> MB: 166.85, shrink: 100.6% > > |---- Cuboid 000101100010100011, est row: 9919, >> est MB: 166.13, shrink: 99.57% > > |---- Cuboid 000101000010100011, est row: >> 9665, est MB: 161.87, shrink: 97.44% > > |---- Cuboid 000100000010100011, est row: >> 7370, est MB: 123.43, shrink: 76.25% > > |---- Cuboid 000111110010100000, est row: 9872, est >> MB: 165.34, shrink: 99.69% > > |---- Cuboid 000101110010100000, est row: 10008, >> est MB: 167.61, shrink: 101.38% > > |---- Cuboid 000101100010100000, est row: >> 9792, est MB: 163.99, shrink: 97.84% > > |---- Cuboid 000101000010100000, est row: >> 9345, est MB: 156.51, shrink: 95.44% > > |---- Cuboid 000100000010100000, est >> row: 4378, est MB: 73.32, shrink: 46.85% > > |---- Cuboid 000111110010101100, est row: 10021, est MB: >> 167.84, shrink: 100.65% > > |---- Cuboid 000101110010101100, est row: 9865, est >> MB: 165.22, shrink: 98.44% > > |---- Cuboid 000101100010101100, est row: 9947, >> est MB: 166.59, shrink: 100.83% > > |---- Cuboid 000101000010101100, est row: >> 9861, est MB: 165.15, shrink: 99.14% > > |---- Cuboid 000100000010101100, est row: >> 8651, est MB: 144.88, shrink: 87.73% > > |---- Cuboid 000111110011110011, est row: 10043, est MB: >> 168.21, shrink: 101.1% > > |---- Cuboid 000101110011110011, est row: 9908, est MB: >> 165.95, shrink: 98.66% > > |---- Cuboid 000101100011110011, est row: 10000, est >> MB: 167.49, shrink: 100.93% > > |---- Cuboid 000101000011110011, est row: 10150, >> est MB: 170, shrink: 101.5% > > |---- Cuboid 000100000011110011, est row: >> 9203, est MB: 154.13, shrink: 90.67% > > |---- Cuboid 000111110011110000, est row: 10008, est MB: >> 167.62, shrink: 99.65% > > |---- Cuboid 000101110011110000, est row: 9960, est >> MB: 166.81, shrink: 99.52% > > |---- Cuboid 000101100011110000, est row: 10046, >> est MB: 168.25, shrink: 100.86% > > |---- Cuboid 000101000011110000, est row: >> 9896, est MB: 165.74, shrink: 98.51% > > |---- Cuboid 000100000011110000, est row: >> 7782, est MB: 130.33, shrink: 78.64% > > |---- Cuboid 000111110011111100, est row: 9987, est MB: >> 167.27, shrink: 100.53% > > |---- Cuboid 000101110011111100, est row: 9916, est MB: >> 166.08, shrink: 99.29% > > |---- Cuboid 000101100011111100, est row: 10091, est >> MB: 169.01, shrink: 101.76% > > |---- Cuboid 000101000011111100, est row: 9918, >> est MB: 166.11, shrink: 98.29% > > |---- Cuboid 000100000011111100, est row: >> 9669, est MB: 161.94, shrink: 97.49% > > |---- Cuboid 000111111101011111, est row: 9921, est MB: 166.17, >> shrink: 100.2% > > |---- Cuboid 000101111101011111, est row: 9967, est MB: >> 166.94, shrink: 100.46% > > |---- Cuboid 000101101101011111, est row: 9941, est MB: >> 166.5, shrink: 99.74% > > |---- Cuboid 000101001101011111, est row: 9997, est >> MB: 167.44, shrink: 100.56% > > |---- Cuboid 000100001101011111, est row: 9973, >> est MB: 167.03, shrink: 99.76% > > |---- Cuboid 000111111100001111, est row: 9989, est MB: >> 167.31, shrink: 100.69% > > |---- Cuboid 000101111100001111, est row: 10063, est MB: >> 168.54, shrink: 100.74% > > |---- Cuboid 000101101100001111, est row: 10094, est >> MB: 169.06, shrink: 100.31% > > |---- Cuboid 000101001100001111, est row: 9934, >> est MB: 166.38, shrink: 98.41% > > |---- Cuboid 000100001100001111, est row: >> 9846, est MB: 164.9, shrink: 99.11% > > |---- Cuboid 000111111100000011, est row: 9982, est MB: >> 167.19, shrink: 99.93% > > |---- Cuboid 000101111100000011, est row: 10150, est >> MB: 170, shrink: 101.68% > > |---- Cuboid 000101101100000011, est row: 9976, >> est MB: 167.08, shrink: 98.29% > > |---- Cuboid 000101001100000011, est row: >> 9885, est MB: 165.55, shrink: 99.09% > > |---- Cuboid 000100001100000011, est row: >> 8840, est MB: 148.05, shrink: 89.43% > > |---- Cuboid 000111111100000000, est row: 10056, est >> MB: 168.42, shrink: 100.74% > > |---- Cuboid 000101111100000000, est row: 10028, >> est MB: 167.95, shrink: 99.72% > > |---- Cuboid 000101101100000000, est row: >> 9872, est MB: 165.33, shrink: 98.44% > > |---- Cuboid 000101001100000000, est row: >> 9761, est MB: 163.47, shrink: 98.88% > > |---- Cuboid 000100001100000000, est >> row: 7056, est MB: 118.17, shrink: 72.29% > > |---- Cuboid 000111111100001100, est row: 10033, est MB: >> 168.04, shrink: 100.44% > > |---- Cuboid 000101111100001100, est row: 10059, est >> MB: 168.47, shrink: 100.26% > > |---- Cuboid 000101101100001100, est row: 9929, >> est MB: 166.29, shrink: 98.71% > > |---- Cuboid 000101001100001100, est row: >> 9885, est MB: 165.55, shrink: 99.56% > > |---- Cuboid 000100001100001100, est row: >> 9342, est MB: 156.46, shrink: 94.51% > > |---- Cuboid 000111111101010011, est row: 10052, est MB: >> 168.36, shrink: 101.32% > > |---- Cuboid 000101111101010011, est row: 10083, est MB: >> 168.88, shrink: 100.31% > > |---- Cuboid 000101101101010011, est row: 10046, est >> MB: 168.26, shrink: 99.63% > > |---- Cuboid 000101001101010011, est row: 10030, >> est MB: 167.99, shrink: 99.84% > > |---- Cuboid 000100001101010011, est row: >> 9843, est MB: 164.85, shrink: 98.14% > > |---- Cuboid 000111111101010000, est row: 10165, est MB: >> 170.25, shrink: 101.12% > > |---- Cuboid 000101111101010000, est row: 9954, est >> MB: 166.71, shrink: 97.92% > > |---- Cuboid 000101101101010000, est row: 9995, >> est MB: 167.4, shrink: 100.41% > > |---- Cuboid 000101001101010000, est row: >> 9984, est MB: 167.21, shrink: 99.89% > > |---- Cuboid 000100001101010000, est row: >> 9566, est MB: 160.21, shrink: 95.81% > > |---- Cuboid 000111111101011100, est row: 9974, est MB: >> 167.06, shrink: 100.53% > > |---- Cuboid 000101111101011100, est row: 9989, est MB: >> 167.3, shrink: 100.15% > > |---- Cuboid 000101101101011100, est row: 10067, est >> MB: 168.61, shrink: 100.78% > > |---- Cuboid 000101001101011100, est row: 10126, >> est MB: 169.59, shrink: 100.59% > > |---- Cuboid 000100001101011100, est row: >> 9982, est MB: 167.18, shrink: 98.58% > > |---- Cuboid 000111111110101111, est row: 10006, est MB: 167.6, >> shrink: 101.06% > > |---- Cuboid 000101111110101111, est row: 10057, est MB: >> 168.45, shrink: 100.51% > > |---- Cuboid 000101101110101111, est row: 10052, est MB: >> 168.36, shrink: 99.95% > > |---- Cuboid 000101001110101111, est row: 9997, est >> MB: 167.44, shrink: 99.45% > > |---- Cuboid 000100001110101111, est row: 10057, >> est MB: 168.44, shrink: 100.6% > > |---- Cuboid 000111111110100011, est row: 10197, est MB: >> 170.79, shrink: 101.91% > > |---- Cuboid 000101111110100011, est row: 10048, est MB: >> 168.29, shrink: 98.54% > > |---- Cuboid 000101101110100011, est row: 9890, est >> MB: 165.64, shrink: 98.43% > > |---- Cuboid 000101001110100011, est row: 10083, >> est MB: 168.87, shrink: 101.95% > > |---- Cuboid 000100001110100011, est row: >> 9772, est MB: 163.66, shrink: 96.92% > > |---- Cuboid 000111111110100000, est row: 10176, est MB: >> 170.43, shrink: 99.79% > > |---- Cuboid 000101111110100000, est row: 9969, est >> MB: 166.97, shrink: 97.97% > > |---- Cuboid 000101101110100000, est row: 9962, >> est MB: 166.85, shrink: 99.93% > > |---- Cuboid 000101001110100000, est row: >> 9978, est MB: 167.11, shrink: 100.16% > > |---- Cuboid 000100001110100000, est row: >> 9550, est MB: 159.94, shrink: 95.71% > > |---- Cuboid 000111111110101100, est row: 9987, est MB: >> 167.27, shrink: 99.81% > > |---- Cuboid 000101111110101100, est row: 10083, est MB: >> 168.88, shrink: 100.96% > > |---- Cuboid 000101101110101100, est row: 10017, est >> MB: 167.77, shrink: 99.35% > > |---- Cuboid 000101001110101100, est row: 9857, >> est MB: 165.09, shrink: 98.4% > > |---- Cuboid 000100001110101100, est row: >> 9865, est MB: 165.22, shrink: 100.08% > > |---- Cuboid 000111111111110011, est row: 9901, est MB: 165.84, >> shrink: 100% > > |---- Cuboid 000101111111110011, est row: 10063, est MB: >> 168.55, shrink: 101.64% > > |---- Cuboid 000101101111110011, est row: 10004, est MB: >> 167.56, shrink: 99.41% > > |---- Cuboid 000101001111110011, est row: 9929, est >> MB: 166.3, shrink: 99.25% > > |---- Cuboid 000100001111110011, est row: 9908, >> est MB: 165.95, shrink: 99.79% > > |---- Cuboid 000111111111110000, est row: 9958, est MB: >> 166.79, shrink: 100.58% > > |---- Cuboid 000101111111110000, est row: 9941, est MB: >> 166.5, shrink: 99.83% > > |---- Cuboid 000101101111110000, est row: 9888, est >> MB: 165.61, shrink: 99.47% > > |---- Cuboid 000101001111110000, est row: 10033, >> est MB: 168.04, shrink: 101.47% > > |---- Cuboid 000100001111110000, est row: >> 9914, est MB: 166.04, shrink: 98.81% > > |---- Cuboid 000111111111111100, est row: 9962, est MB: 166.86, >> shrink: 100.62% > > |---- Cuboid 000101111111111100, est row: 10030, est MB: 168, >> shrink: 100.68% > > |---- Cuboid 000101101111111100, est row: 9995, est MB: >> 167.41, shrink: 99.65% > > |---- Cuboid 000101001111111100, est row: 9896, est >> MB: 165.75, shrink: 99.01% > > |---- Cuboid 000100001111111100, est row: 10065, >> est MB: 168.58, shrink: 101.71% > > 2017-11-23 10:50 GMT+08:00 Li Yang <liy...@apache.org>: > Don't think so. With only AGG2, the combination of [cal_dt, city, > buyer_id] is not computed at all. > > On Mon, Nov 20, 2017 at 1:59 PM, 杨浩 <yangha...@gmail.com> wrote: > >> So, shall we change the document to delete the AGG1 , and says it is >> computed by default? >> >> 2017-11-20 8:55 GMT+08:00 ShaoFeng Shi <shaofeng...@apache.org>: >> >>> Yes, the base cuboid is the cuboid of all dimensions on rowkey. It is >>> the parent of all AGG. >>> >>> 2017-11-19 16:06 GMT+08:00 杨浩 <yangha...@gmail.com>: >>> >>>> As in the article http://kylin.apache.org/blog/2016/02/18/new-aggregat >>>> ion-group/ , two aggs are defined in the last. The AGG1 is base >>>> cuboid, shall we define it explicity? It seems the base cuboid is computed >>>> implicit >>>> >>>> >>> >>> >>> -- >>> Best regards, >>> >>> Shaofeng Shi 史少锋 >>> >>> >> >