[jira] [Commented] (KYLIN-3997) Add a health check job of Kylin
[
https://issues.apache.org/jira/browse/KYLIN-3997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16859456#comment-16859456
]
ASF GitHub Bot commented on KYLIN-3997:
---
nichunen commented on pull request #669: KYLIN-3997: Add a health check job of
Kylin
URL: https://github.com/apache/kylin/pull/669
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
> Add a health check job of Kylin
> ---
>
> Key: KYLIN-3997
> URL: https://issues.apache.org/jira/browse/KYLIN-3997
> Project: Kylin
> Issue Type: Improvement
>Reporter: Liu Shaohui
>Assignee: Liu Shaohui
>Priority: Major
>
> Kylin has many inner meta data and outer dependencies. There may be
> inconsistent for bugs or failures. It's better to have a a health check job
> to find these inconsistent issues in advance。
> The inconsistent issues we found in our clusters are followings
> * {color:#808080}the cubeid data not exist for cube merging{color}
> * {color:#808080}hbase table not exist or online for a segment{color}
> * {color:#808080}there are holes in cube segments(The build of some days
> failed, but user not found it){color}
> * {color:#808080}Too many segment(hbase tables){color}
> * {color:#808080}metadata of stale segment left in cube{color}
> * {color:#808080}Some cubes have not be updated/built for a long time{color}
> * {color:#808080}Some important parameters are no set in cube desc{color}
> * {color:#808080}...{color}
> Suggestions are welcomed, thanks~
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (KYLIN-3997) Add a health check job of Kylin
[
https://issues.apache.org/jira/browse/KYLIN-3997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16859457#comment-16859457
]
ASF subversion and git services commented on KYLIN-3997:
Commit 1fb000e45fb299ff40b9af6d197028dfee29a90b in kylin's branch
refs/heads/master from Liu Shaohui
[ https://gitbox.apache.org/repos/asf?p=kylin.git;h=1fb000e ]
KYLIN-3997: Add a health check job of Kylin
> Add a health check job of Kylin
> ---
>
> Key: KYLIN-3997
> URL: https://issues.apache.org/jira/browse/KYLIN-3997
> Project: Kylin
> Issue Type: Improvement
>Reporter: Liu Shaohui
>Assignee: Liu Shaohui
>Priority: Major
>
> Kylin has many inner meta data and outer dependencies. There may be
> inconsistent for bugs or failures. It's better to have a a health check job
> to find these inconsistent issues in advance。
> The inconsistent issues we found in our clusters are followings
> * {color:#808080}the cubeid data not exist for cube merging{color}
> * {color:#808080}hbase table not exist or online for a segment{color}
> * {color:#808080}there are holes in cube segments(The build of some days
> failed, but user not found it){color}
> * {color:#808080}Too many segment(hbase tables){color}
> * {color:#808080}metadata of stale segment left in cube{color}
> * {color:#808080}Some cubes have not be updated/built for a long time{color}
> * {color:#808080}Some important parameters are no set in cube desc{color}
> * {color:#808080}...{color}
> Suggestions are welcomed, thanks~
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (KYLIN-3997) Add a health check job of Kylin
[
https://issues.apache.org/jira/browse/KYLIN-3997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16859431#comment-16859431
]
XiaoXiang Yu commented on KYLIN-3997:
-
Use this feature by add following if you are using 126.com:
{code}
kylin.job.notification-enabled=true
kylin.job.notification-mail-enable-starttls=true
kylin.job.notification-mail-host=smtp.126.com
kylin.job.notification-mail-username= hah...@126.com
kylin.job.notification-mail-password=hahaha
kylin.job.notification-mail-sender=hah...@126.com
kylin.job.notification-admin-emails=hah...@kyligence.io,hah...@126.com
{code}
After start the Kylin process, you should execute following command and get
email received.
{code}sh bin/kylin.sh org.apache.kylin.tool.KylinHealthCheckJob
{code}
> Add a health check job of Kylin
> ---
>
> Key: KYLIN-3997
> URL: https://issues.apache.org/jira/browse/KYLIN-3997
> Project: Kylin
> Issue Type: Improvement
>Reporter: Liu Shaohui
>Assignee: Liu Shaohui
>Priority: Major
>
> Kylin has many inner meta data and outer dependencies. There may be
> inconsistent for bugs or failures. It's better to have a a health check job
> to find these inconsistent issues in advance。
> The inconsistent issues we found in our clusters are followings
> * {color:#808080}the cubeid data not exist for cube merging{color}
> * {color:#808080}hbase table not exist or online for a segment{color}
> * {color:#808080}there are holes in cube segments(The build of some days
> failed, but user not found it){color}
> * {color:#808080}Too many segment(hbase tables){color}
> * {color:#808080}metadata of stale segment left in cube{color}
> * {color:#808080}Some cubes have not be updated/built for a long time{color}
> * {color:#808080}Some important parameters are no set in cube desc{color}
> * {color:#808080}...{color}
> Suggestions are welcomed, thanks~
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (KYLIN-3997) Add a health check job of Kylin
[
https://issues.apache.org/jira/browse/KYLIN-3997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16853855#comment-16853855
]
Shaofeng SHI commented on KYLIN-3997:
-
+1 good feature for Kylin administrators!
> Add a health check job of Kylin
> ---
>
> Key: KYLIN-3997
> URL: https://issues.apache.org/jira/browse/KYLIN-3997
> Project: Kylin
> Issue Type: Improvement
>Reporter: Liu Shaohui
>Assignee: Liu Shaohui
>Priority: Major
>
> Kylin has many inner meta data and outer dependencies. There may be
> inconsistent for bugs or failures. It's better to have a a health check job
> to find these inconsistent issues in advance。
> The inconsistent issues we found in our clusters are followings
> * {color:#808080}the cubeid data not exist for cube merging{color}
> * {color:#808080}hbase table not exist or online for a segment{color}
> * {color:#808080}there are holes in cube segments(The build of some days
> failed, but user not found it){color}
> * {color:#808080}Too many segment(hbase tables){color}
> * {color:#808080}metadata of stale segment left in cube{color}
> * {color:#808080}Some cubes have not be updated/built for a long time{color}
> * {color:#808080}Some important parameters are no set in cube desc{color}
> * {color:#808080}...{color}
> Suggestions are welcomed, thanks~
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (KYLIN-3997) Add a health check job of Kylin
[
https://issues.apache.org/jira/browse/KYLIN-3997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16852866#comment-16852866
]
ASF GitHub Bot commented on KYLIN-3997:
---
lshmouse commented on pull request #669: KYLIN-3997: Add a health check job of
Kylin
URL: https://github.com/apache/kylin/pull/669
See: https://issues.apache.org/jira/browse/KYLIN-3997
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
> Add a health check job of Kylin
> ---
>
> Key: KYLIN-3997
> URL: https://issues.apache.org/jira/browse/KYLIN-3997
> Project: Kylin
> Issue Type: Improvement
>Reporter: Liu Shaohui
>Assignee: Liu Shaohui
>Priority: Major
>
> Kylin has many inner meta data and outer dependencies. There may be
> inconsistent for bugs or failures. It's better to have a a health check job
> to find these inconsistent issues in advance。
> The inconsistent issues we found in our clusters are followings
> * {color:#808080}the cubeid data not exist for cube merging{color}
> * {color:#808080}hbase table not exist or online for a segment{color}
> * {color:#808080}there are holes in cube segments(The build of some days
> failed, but user not found it){color}
> * {color:#808080}Too many segment(hbase tables){color}
> * {color:#808080}metadata of stale segment left in cube{color}
> * {color:#808080}Some cubes have not be updated/built for a long time{color}
> * {color:#808080}Some important parameters are no set in cube desc{color}
> * {color:#808080}...{color}
> Suggestions are welcomed, thanks~
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (KYLIN-3997) Add a health check job of Kylin
[
https://issues.apache.org/jira/browse/KYLIN-3997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16836016#comment-16836016
]
Liu Shaohui commented on KYLIN-3997:
[~nichunen] It will be a script or background task like the storage cleanup job.
> Add a health check job of Kylin
> ---
>
> Key: KYLIN-3997
> URL: https://issues.apache.org/jira/browse/KYLIN-3997
> Project: Kylin
> Issue Type: Improvement
>Reporter: Liu Shaohui
>Assignee: Liu Shaohui
>Priority: Major
>
> Kylin has many inner meta data and outer dependencies. There may be
> inconsistent for bugs or failures. It's better to have a a health check job
> to find these inconsistent issues in advance。
> The inconsistent issues we found in our clusters are followings
> * {color:#808080}the cubeid data not exist for cube merging{color}
> * {color:#808080}hbase table not exist or online for a segment{color}
> * {color:#808080}there are holes in cube segments(The build of some days
> failed, but user not found it){color}
> * {color:#808080}Too many segment(hbase tables){color}
> * {color:#808080}metadata of stale segment left in cube{color}
> * {color:#808080}Some cubes have not be updated/built for a long time{color}
> * {color:#808080}Some important parameters are no set in cube desc{color}
> * {color:#808080}...{color}
> Suggestions are welcomed, thanks~
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (KYLIN-3997) Add a health check job of Kylin
[
https://issues.apache.org/jira/browse/KYLIN-3997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16835322#comment-16835322
]
nichunen commented on KYLIN-3997:
-
Hi, Shaohui.
Good idea(y)
In your design, the health check will be done by script or by tomcat server?
> Add a health check job of Kylin
> ---
>
> Key: KYLIN-3997
> URL: https://issues.apache.org/jira/browse/KYLIN-3997
> Project: Kylin
> Issue Type: Improvement
>Reporter: Liu Shaohui
>Assignee: Liu Shaohui
>Priority: Major
>
> Kylin has many inner meta data and outer dependencies. There may be no
> inconsistent for bugs or failures. It's better to have a a health check job
> to find these inconsistent issues in advance。
> The inconsistent issues we found in our clusters are followings
> * {color:#808080}the cubeid data not exist for cube merging{color}
> * {color:#808080}hbase table not exist or online for a segment{color}
> * {color:#808080}there are holes in cube segments(The build of some days
> failed, but user not found it){color}
> * {color:#808080}Too many segment(hbase tables){color}
> * {color:#808080}metadata of stale segment left in cube{color}
> * {color:#808080}Some cubes have not be updated/built for a long time{color}
> * {color:#808080}Some important parameters are no set in cube desc{color}
> * {color:#808080}...{color}
> Suggestions are welcomed, thanks~
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
