[jira] [Updated] (KYLIN-4679) StorageCleanupJob clean hive table support hive table prefix

[ https://issues.apache.org/jira/browse/KYLIN-4679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chuxiao updated KYLIN-4679: --- Description: 我的库有几千张表。StorageCleanupJob的行为是获取库里所有表的元数据再过滤表名。首先，取所有表元数据的行为会给metastore较大压力。其次，我们的metastore当一次取超

[GitHub] [kylin] bigxiaochu commented on pull request #1347: KYLIN-4686 clean metadata support to delete all jobs

bigxiaochu commented on pull request #1347: URL: https://github.com/apache/kylin/pull/1347#issuecomment-671203988 @hit-lacus update issue content This is an automated message from the Apache Git Service. To respond to the mes

[jira] [Commented] (KYLIN-4686) clean metadata support to delete all jobs

[ https://issues.apache.org/jira/browse/KYLIN-4686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17174135#comment-17174135 ] ASF GitHub Bot commented on KYLIN-4686: --- bigxiaochu commented on pull request #1347

[GitHub] [kylin] bigxiaochu commented on pull request #1349: KYLIN-4687 add unify clean sh to excute some clean shells

bigxiaochu commented on pull request #1349: URL: https://github.com/apache/kylin/pull/1349#issuecomment-671204769 @hit-lacus remove deleteAllJobs This is an automated message from the Apache Git Service. To respond to the mes

[jira] [Commented] (KYLIN-4687) add unify clean sh to excute some clean shells

[ https://issues.apache.org/jira/browse/KYLIN-4687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17174136#comment-17174136 ] ASF GitHub Bot commented on KYLIN-4687: --- bigxiaochu commented on pull request #1349

[GitHub] [kylin] codecov-commenter commented on pull request #1349: KYLIN-4687 add unify clean sh to excute some clean shells

codecov-commenter commented on pull request #1349: URL: https://github.com/apache/kylin/pull/1349#issuecomment-671214153 # [Codecov](https://codecov.io/gh/apache/kylin/pull/1349?src=pr&el=h1) Report > Merging [#1349](https://codecov.io/gh/apache/kylin/pull/1349?src=pr&el=desc) into [mas

[jira] [Commented] (KYLIN-4687) add unify clean sh to excute some clean shells

[ https://issues.apache.org/jira/browse/KYLIN-4687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17174160#comment-17174160 ] ASF GitHub Bot commented on KYLIN-4687: --- codecov-commenter commented on pull reques

[jira] [Commented] (KYLIN-4688) Too many tmp files in HDFS tmp dictionary

[ https://issues.apache.org/jira/browse/KYLIN-4688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17174256#comment-17174256 ] wangrupeng commented on KYLIN-4688: --- As far as I'm concerned, HDFS won't delete file in

[jira] [Commented] (KYLIN-4688) Too many tmp files in HDFS tmp dictionary

[ https://issues.apache.org/jira/browse/KYLIN-4688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17174259#comment-17174259 ] wangrupeng commented on KYLIN-4688: --- Where does the default value of "hbase.fs.tmp.dir"

[jira] [Commented] (KYLIN-4688) Too many tmp files in HDFS tmp dictionary

[ https://issues.apache.org/jira/browse/KYLIN-4688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17174261#comment-17174261 ] QiangZhang commented on KYLIN-4688: --- This is a complex process, which I will update lat

[jira] [Issue Comment Deleted] (KYLIN-4688) Too many tmp files in HDFS tmp dictionary

[ https://issues.apache.org/jira/browse/KYLIN-4688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] QiangZhang updated KYLIN-4688: -- Comment: was deleted (was: This is a complex process, which I will update later in JIRA ) > Too many t

[jira] [Comment Edited] (KYLIN-4688) Too many tmp files in HDFS tmp dictionary

[ https://issues.apache.org/jira/browse/KYLIN-4688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17172257#comment-17172257 ] QiangZhang edited comment on KYLIN-4688 at 8/10/20, 11:38 AM: -

[jira] [Comment Edited] (KYLIN-4688) Too many tmp files in HDFS tmp dictionary

[ https://issues.apache.org/jira/browse/KYLIN-4688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17172257#comment-17172257 ] QiangZhang edited comment on KYLIN-4688 at 8/10/20, 11:39 AM: -

[jira] [Comment Edited] (KYLIN-4688) Too many tmp files in HDFS tmp dictionary

[ https://issues.apache.org/jira/browse/KYLIN-4688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17172257#comment-17172257 ] QiangZhang edited comment on KYLIN-4688 at 8/10/20, 11:39 AM: -

[jira] [Comment Edited] (KYLIN-4688) Too many tmp files in HDFS tmp dictionary

[ https://issues.apache.org/jira/browse/KYLIN-4688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17172257#comment-17172257 ] QiangZhang edited comment on KYLIN-4688 at 8/10/20, 11:47 AM: -

[jira] [Updated] (KYLIN-4688) Too many tmp files in HDFS tmp dictionary

[ https://issues.apache.org/jira/browse/KYLIN-4688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] QiangZhang updated KYLIN-4688: -- Attachment: image-2020-08-10-20-06-01-526.png > Too many tmp files in HDFS tmp dictionary > ---

[jira] [Updated] (KYLIN-4688) Too many tmp files in HDFS tmp dictionary

[ https://issues.apache.org/jira/browse/KYLIN-4688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] QiangZhang updated KYLIN-4688: -- Attachment: image-2020-08-10-20-14-53-854.png > Too many tmp files in HDFS tmp dictionary > ---

[jira] [Updated] (KYLIN-4688) Too many tmp files in HDFS tmp dictionary

[ https://issues.apache.org/jira/browse/KYLIN-4688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] QiangZhang updated KYLIN-4688: -- Attachment: image-2020-08-10-20-18-10-513.png > Too many tmp files in HDFS tmp dictionary > ---

[jira] [Updated] (KYLIN-4688) Too many tmp files in HDFS tmp dictionary

[ https://issues.apache.org/jira/browse/KYLIN-4688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] QiangZhang updated KYLIN-4688: -- Attachment: image-2020-08-10-20-20-07-899.png > Too many tmp files in HDFS tmp dictionary > ---

[jira] [Updated] (KYLIN-4688) Too many tmp files in HDFS tmp dictionary

[ https://issues.apache.org/jira/browse/KYLIN-4688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] QiangZhang updated KYLIN-4688: -- Attachment: image-2020-08-10-20-21-44-137.png > Too many tmp files in HDFS tmp dictionary > ---

[jira] [Commented] (KYLIN-4688) Too many tmp files in HDFS tmp dictionary

[ https://issues.apache.org/jira/browse/KYLIN-4688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17174278#comment-17174278 ] QiangZhang commented on KYLIN-4688: --- This is a complicated process. Let's analyze it st

[jira] [Comment Edited] (KYLIN-4688) Too many tmp files in HDFS tmp dictionary

[ https://issues.apache.org/jira/browse/KYLIN-4688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17174278#comment-17174278 ] QiangZhang edited comment on KYLIN-4688 at 8/10/20, 12:25 PM: -

[jira] [Updated] (KYLIN-4688) Too many tmp files in HDFS tmp dictionary

[ https://issues.apache.org/jira/browse/KYLIN-4688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangrupeng updated KYLIN-4688: -- Attachment: image-2020-08-10-20-49-46-354.png > Too many tmp files in HDFS tmp dictionary > ---

[jira] [Commented] (KYLIN-4688) Too many tmp files in HDFS tmp dictionary

[ https://issues.apache.org/jira/browse/KYLIN-4688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17174298#comment-17174298 ] wangrupeng commented on KYLIN-4688: --- The 3rd problem you mensioned, it's not cleanup tm

[jira] [Commented] (KYLIN-4690) BUILD CUBE - job fail on spark clusters mode - #7 Step Name: Build Cube with Spark

[ https://issues.apache.org/jira/browse/KYLIN-4690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17174300#comment-17174300 ] wangrupeng commented on KYLIN-4690: --- Could you provide more information about your envi

[jira] [Comment Edited] (KYLIN-4690) BUILD CUBE - job fail on spark clusters mode - #7 Step Name: Build Cube with Spark

[ https://issues.apache.org/jira/browse/KYLIN-4690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17174300#comment-17174300 ] wangrupeng edited comment on KYLIN-4690 at 8/10/20, 12:57 PM: -

[jira] [Commented] (KYLIN-4688) Too many tmp files in HDFS tmp dictionary

[ https://issues.apache.org/jira/browse/KYLIN-4688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17175149#comment-17175149 ] QiangZhang commented on KYLIN-4688: --- 1.I don’t think so ，the "partitionsPath" is just a

[GitHub] [kylin] hit-lacus commented on pull request #1347: KYLIN-4686 clean metadata support to delete all jobs

hit-lacus commented on pull request #1347: URL: https://github.com/apache/kylin/pull/1347#issuecomment-671696726 Thank you for information provided. In general, this code change looks good to me. This is an automated message

[jira] [Commented] (KYLIN-4686) clean metadata support to delete all jobs

[ https://issues.apache.org/jira/browse/KYLIN-4686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17175180#comment-17175180 ] ASF GitHub Bot commented on KYLIN-4686: --- hit-lacus commented on pull request #1347:

[GitHub] [kylin] hit-lacus merged pull request #1347: KYLIN-4686 clean metadata support to delete all jobs

hit-lacus merged pull request #1347: URL: https://github.com/apache/kylin/pull/1347 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [kylin] hit-lacus commented on pull request #1347: KYLIN-4686 clean metadata support to delete all jobs

hit-lacus commented on pull request #1347: URL: https://github.com/apache/kylin/pull/1347#issuecomment-671696974 Since it should be a non-breaking enhancement, I will merge it. This is an automated message from the Apache Git

[jira] [Commented] (KYLIN-4686) clean metadata support to delete all jobs

[ https://issues.apache.org/jira/browse/KYLIN-4686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17175182#comment-17175182 ] ASF GitHub Bot commented on KYLIN-4686: --- hit-lacus commented on pull request #1347:

[jira] [Commented] (KYLIN-4686) clean metadata support to delete all jobs

[ https://issues.apache.org/jira/browse/KYLIN-4686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17175183#comment-17175183 ] ASF GitHub Bot commented on KYLIN-4686: --- hit-lacus merged pull request #1347: URL:

[jira] [Commented] (KYLIN-4686) clean metadata support to delete all jobs

[ https://issues.apache.org/jira/browse/KYLIN-4686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17175184#comment-17175184 ] ASF subversion and git services commented on KYLIN-4686: Commit 2

[jira] [Commented] (KYLIN-4685) return user friendly msg when stackoverflowerror

[ https://issues.apache.org/jira/browse/KYLIN-4685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17175190#comment-17175190 ] ASF GitHub Bot commented on KYLIN-4685: --- hit-lacus commented on pull request #1345:

[GitHub] [kylin] hit-lacus merged pull request #1345: KYLIN-4685 return user friendly msg when stackoverflowerror

hit-lacus merged pull request #1345: URL: https://github.com/apache/kylin/pull/1345 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[jira] [Commented] (KYLIN-4685) return user friendly msg when stackoverflowerror

[ https://issues.apache.org/jira/browse/KYLIN-4685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17175192#comment-17175192 ] ASF GitHub Bot commented on KYLIN-4685: --- hit-lacus merged pull request #1345: URL:

[jira] [Commented] (KYLIN-4685) return user friendly msg when stackoverflowerror

[ https://issues.apache.org/jira/browse/KYLIN-4685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17175191#comment-17175191 ] ASF subversion and git services commented on KYLIN-4685: Commit 5

[GitHub] [kylin] hit-lacus commented on pull request #1345: KYLIN-4685 return user friendly msg when stackoverflowerror

hit-lacus commented on pull request #1345: URL: https://github.com/apache/kylin/pull/1345#issuecomment-671698395 Thank you @bigxiaochu , please go ahead. I will merge this patch. This is an automated message from the Apache G

[GitHub] [kylin] hit-lacus commented on pull request #1349: KYLIN-4687 add unify clean sh to excute some clean shells

hit-lacus commented on pull request #1349: URL: https://github.com/apache/kylin/pull/1349#issuecomment-671697678 In general, this looks fine to me. Since it should be a non-breaking enhancement, I will merge it. This is an

[GitHub] [kylin] hit-lacus commented on pull request #1314: KYLIN-4628: Fail to use custom measure when specifying cube to query

hit-lacus commented on pull request #1314: URL: https://github.com/apache/kylin/pull/1314#issuecomment-671702058 Thank you for your contribution , we will check this code change later. This is an automated message from the Ap

[GitHub] [kylin] hit-lacus merged pull request #1349: KYLIN-4687 add unify clean sh to excute some clean shells

hit-lacus merged pull request #1349: URL: https://github.com/apache/kylin/pull/1349 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[jira] [Commented] (KYLIN-4628) Fail to use custom measure type when specifying cube to query

[ https://issues.apache.org/jira/browse/KYLIN-4628?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17175196#comment-17175196 ] ASF GitHub Bot commented on KYLIN-4628: --- hit-lacus commented on pull request #1314:

[jira] [Commented] (KYLIN-4687) add unify clean sh to excute some clean shells

[ https://issues.apache.org/jira/browse/KYLIN-4687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17175188#comment-17175188 ] ASF GitHub Bot commented on KYLIN-4687: --- hit-lacus merged pull request #1349: URL:

[jira] [Commented] (KYLIN-4687) add unify clean sh to excute some clean shells

[ https://issues.apache.org/jira/browse/KYLIN-4687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17175186#comment-17175186 ] ASF GitHub Bot commented on KYLIN-4687: --- hit-lacus commented on pull request #1349:

[jira] [Commented] (KYLIN-4687) add unify clean sh to excute some clean shells

[ https://issues.apache.org/jira/browse/KYLIN-4687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17175187#comment-17175187 ] ASF subversion and git services commented on KYLIN-4687: Commit a