[ https://issues.apache.org/jira/browse/KYLIN-4445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Xiaoxiang Yu closed KYLIN-4445. ------------------------------- Resolved in release 3.1.0 (2020-07-03) > Provide a kylin on kubernetes solution > -------------------------------------- > > Key: KYLIN-4445 > URL: https://issues.apache.org/jira/browse/KYLIN-4445 > Project: Kylin > Issue Type: New Feature > Components: Integration > Reporter: Xiaoxiang Yu > Assignee: Xiaoxiang Yu > Priority: Major > Labels: Kubernetes > Fix For: v3.1.0 > > Attachments: image-2020-04-22-17-35-53-990.png > > Original Estimate: 240h > Time Spent: 240h > Remaining Estimate: 360h > > h2. Backgroud > From experience of kylin user, like *OLX group*, *DXY.cn* and *eBay*, they > choose to deploy kylin and its dependency in Kubernetes . And their > approach/practice is proved works well in production env and these deployment > template could be share in Kylin community. > > This pic is an example of Kylin on Kubernetes 's architecture. > !image-2020-04-22-17-35-53-990.png! > ---- > Following are some of the patch lists: > * [https://github.com/sanjulian/kylin/pull/1] > * [https://github.com/apache/kylin/pull/864] > > h2. Proposal > At high level, I proposed to provided two deployment templates, one for > quick-start purpose, another for production/distributed deployment. > > Quick-start template is for one node deployment with an > *{color:#de350b}ALL{color}* kylin instance. > Production template is for multi-nodes deployment with a few of > *{color:#de350b}ALL{color}*/{color:#de350b}*job*{color}/{color:#de350b}*query*{color} > kylin instances; and some other service like *memcached* and *filebeat* will > help to solve log collection/query cache/session sharing. > Following is the structure of provided deployment template: > # _config_ is the place of store configuration file of Hadoop/Kylin ; > # _docker_ is the place which you can build *hadoop-client* and > *kylin-client* docker image yourself. > # _kubernetes_ is the place for storing deployment template. > {code:sh} > apache-kylin:k8s/ (kubernetes*) $ tree -L 3 > [16:31:09] > . > ├── config > │ ├── production > │ │ ├── filebeat > │ │ ├── hadoop > │ │ ├── kerberos > │ │ ├── kylin-all > │ │ ├── kylin-job > │ │ ├── kylin-more > │ │ ├── kylin-query > │ │ ├── sso > │ │ ├── streaming-receiver > │ │ └── tomcat > │ └── quickstart > │ ├── hadoop > │ └── kylin > ├── docker > │ ├── build.sh > │ ├── hadoop-client > │ │ ├── CDH-5.7 > │ │ ├── README.MD > │ │ ├── apache-hadoop2.7 > │ │ └── provided-binary > │ └── kylin-client > │ ├── Dockerfile > │ ├── apache-kylin-x.x.x-bin-cdh57 > │ ├── bin > │ ├── build.sh > │ └── crontab.txt > └── kubernetes > ├── production > │ ├── check-deploy.sh > │ ├── cleanup.sh > │ ├── deploy-kylin.sh > │ └── deployment > └── quickstart > ├── check-cluster.sh > ├── cleanup.sh > ├── deploy-kylin.sh > └── deployment > {code} > h2. Credits > - DXY.cn [~ztp] > - eBay team [~julianpan] -- This message was sent by Atlassian Jira (v8.3.4#803005)