[incubator-doris] branch master updated: 1. Delete the code of Sort Node we do not use now. (#3666)

2020-05-25 Thread lichaoyong
This is an automated email from the ASF dual-hosted git repository. lichaoyong pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-doris.git The following commit(s) were added to refs/heads/master by this push: new f4c03fe 1. Delete the code of Sort

[incubator-doris] branch branch-0.12 updated: Override the style of sidebar's sub-direcotry (#3684)

2020-05-25 Thread zhaoc
This is an automated email from the ASF dual-hosted git repository. zhaoc pushed a commit to branch branch-0.12 in repository https://gitbox.apache.org/repos/asf/incubator-doris.git The following commit(s) were added to refs/heads/branch-0.12 by this push: new 2252649 Override the style of

[incubator-doris] branch master updated (3ffc447 -> 963d4d4)

2020-05-25 Thread zhaoc
This is an automated email from the ASF dual-hosted git repository. zhaoc pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/incubator-doris.git. from 3ffc447 [OUTFILE] Support `INTO OUTFILE` to export query result (#3584) add 963d4d4 Override the styl

[incubator-doris] branch branch-0.11 updated: Override the style of sidebar's sub-direcotry (#3685)

2020-05-25 Thread zhaoc
This is an automated email from the ASF dual-hosted git repository. zhaoc pushed a commit to branch branch-0.11 in repository https://gitbox.apache.org/repos/asf/incubator-doris.git The following commit(s) were added to refs/heads/branch-0.11 by this push: new f463fbe Override the style of

[GitHub] [incubator-doris] morningman commented on a change in pull request #3679: [DynamicPartition] Optimize the rule of creating dynamic partition

2020-05-25 Thread GitBox
morningman commented on a change in pull request #3679: URL: https://github.com/apache/incubator-doris/pull/3679#discussion_r429937221 ## File path: fe/src/main/java/org/apache/doris/clone/DynamicPartitionScheduler.java ## @@ -210,7 +215,8 @@ public void createOrUpdateRuntimeI

[GitHub] [incubator-doris] morningman commented on a change in pull request #3679: [DynamicPartition] Optimize the rule of creating dynamic partition

2020-05-25 Thread GitBox
morningman commented on a change in pull request #3679: URL: https://github.com/apache/incubator-doris/pull/3679#discussion_r429936606 ## File path: fe/src/main/java/org/apache/doris/clone/DynamicPartitionScheduler.java ## @@ -275,19 +280,25 @@ private void executeDynamicParti

[GitHub] [incubator-doris] EmmyMiao87 commented on pull request #3686: [Bug] Serialize storage format in rollup job

2020-05-25 Thread GitBox
EmmyMiao87 commented on pull request #3686: URL: https://github.com/apache/incubator-doris/pull/3686#issuecomment-633572709 > @EmmyMiao87 Hi, Please add a UT to cover RollupJobV2 Serde. Thanks. Added This is an automat

[GitHub] [incubator-doris] morningman merged pull request #3584: [OUTFILE] Support `INTO OUTFILE` to export query result

2020-05-25 Thread GitBox
morningman merged pull request #3584: URL: https://github.com/apache/incubator-doris/pull/3584 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abov

[incubator-doris] branch master updated (6788cac -> 3ffc447)

2020-05-25 Thread morningman
This is an automated email from the ASF dual-hosted git repository. morningman pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/incubator-doris.git. from 6788cac Fix unit test failed (#3642) add 3ffc447 [OUTFILE] Support `INTO OUTFILE` to export query

[GitHub] [incubator-doris] kangkaisen commented on pull request #3686: [Bug] Serialize storage format in rollup job

2020-05-25 Thread GitBox
kangkaisen commented on pull request #3686: URL: https://github.com/apache/incubator-doris/pull/3686#issuecomment-633547441 @EmmyMiao87 Hi, Please add a UT to cover RollupJobV2 Serde. Thanks. This is an automated message from

[GitHub] [incubator-doris] chaoyli edited a comment on pull request #3635: [Enhancement] Convert metric to Json format

2020-05-25 Thread GitBox
chaoyli edited a comment on pull request #3635: URL: https://github.com/apache/incubator-doris/pull/3635#issuecomment-633538300 > > > Why we need a json format metric output? > > > > > > It's for incorporating another Monitor Tools easily. Json will be a good choice for this dema

[GitHub] [incubator-doris] chaoyli commented on pull request #3635: [Enhancement] Convert metric to Json format

2020-05-25 Thread GitBox
chaoyli commented on pull request #3635: URL: https://github.com/apache/incubator-doris/pull/3635#issuecomment-633538300 > > > Why we need a json format metric output? > > > > > > It's for incorporating another Monitor Tools easily. Json will be a good choice for this demand.

[GitHub] [incubator-doris] WingsGo commented on a change in pull request #3679: [DynamicPartition] Optimize the rule of creating dynamic partition

2020-05-25 Thread GitBox
WingsGo commented on a change in pull request #3679: URL: https://github.com/apache/incubator-doris/pull/3679#discussion_r429897947 ## File path: fe/src/main/java/org/apache/doris/common/util/DynamicPartitionUtil.java ## @@ -114,6 +118,34 @@ private static void checkEnable(Str

[GitHub] [incubator-doris] WingsGo commented on a change in pull request #3679: [DynamicPartition] Optimize the rule of creating dynamic partition

2020-05-25 Thread GitBox
WingsGo commented on a change in pull request #3679: URL: https://github.com/apache/incubator-doris/pull/3679#discussion_r429897271 ## File path: fe/src/main/java/org/apache/doris/clone/DynamicPartitionScheduler.java ## @@ -275,19 +280,25 @@ private void executeDynamicPartitio

[GitHub] [incubator-doris] WingsGo commented on a change in pull request #3679: [DynamicPartition] Optimize the rule of creating dynamic partition

2020-05-25 Thread GitBox
WingsGo commented on a change in pull request #3679: URL: https://github.com/apache/incubator-doris/pull/3679#discussion_r429896775 ## File path: fe/src/main/java/org/apache/doris/clone/DynamicPartitionScheduler.java ## @@ -149,10 +148,11 @@ public void createOrUpdateRuntimeIn

[GitHub] [incubator-doris] WingsGo commented on a change in pull request #3679: [DynamicPartition] Optimize the rule of creating dynamic partition

2020-05-25 Thread GitBox
WingsGo commented on a change in pull request #3679: URL: https://github.com/apache/incubator-doris/pull/3679#discussion_r429885387 ## File path: fe/src/main/java/org/apache/doris/common/util/DynamicPartitionUtil.java ## @@ -273,34 +321,110 @@ public static String getPartition

[GitHub] [incubator-doris] sduzh opened a new issue #3688: Query with a cast in where clause returned wrong result

2020-05-25 Thread GitBox
sduzh opened a new issue #3688: URL: https://github.com/apache/incubator-doris/issues/3688 **Describe the bug** If there are `cast` statements in where clause, a wrong result may be returned. **To Reproduce** ``` create table t1(k bigint not null) DISTRIBUTED BY HASH(k) BUCK

[GitHub] [incubator-doris] WingsGo commented on a change in pull request #3679: [DynamicPartition] Optimize the rule of creating dynamic partition

2020-05-25 Thread GitBox
WingsGo commented on a change in pull request #3679: URL: https://github.com/apache/incubator-doris/pull/3679#discussion_r429878339 ## File path: fe/src/main/java/org/apache/doris/common/util/DynamicPartitionUtil.java ## @@ -273,34 +321,110 @@ public static String getPartition

[GitHub] [incubator-doris] WingsGo commented on a change in pull request #3679: [DynamicPartition] Optimize the rule of creating dynamic partition

2020-05-25 Thread GitBox
WingsGo commented on a change in pull request #3679: URL: https://github.com/apache/incubator-doris/pull/3679#discussion_r429878339 ## File path: fe/src/main/java/org/apache/doris/common/util/DynamicPartitionUtil.java ## @@ -273,34 +321,110 @@ public static String getPartition

[incubator-doris] branch master updated: Fix unit test failed (#3642)

2020-05-25 Thread zhaoc
This is an automated email from the ASF dual-hosted git repository. zhaoc pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-doris.git The following commit(s) were added to refs/heads/master by this push: new 6788cac Fix unit test failed (#3642) 67

[GitHub] [incubator-doris] imay merged pull request #3642: Fix some unit test failed

2020-05-25 Thread GitBox
imay merged pull request #3642: URL: https://github.com/apache/incubator-doris/pull/3642 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to g

[GitHub] [incubator-doris] WingsGo commented on pull request #3527: [SQL]When compare StringLiteral and Numerical, cast them to Numerical type

2020-05-25 Thread GitBox
WingsGo commented on pull request #3527: URL: https://github.com/apache/incubator-doris/pull/3527#issuecomment-633509376 Hi, @morningman @imay , this PR is ready for review This is an automated message from the Apache Git Ser

[GitHub] [incubator-doris] WingsGo commented on a change in pull request #3679: [DynamicPartition] Optimize the rule of creating dynamic partition

2020-05-25 Thread GitBox
WingsGo commented on a change in pull request #3679: URL: https://github.com/apache/incubator-doris/pull/3679#discussion_r429862055 ## File path: fe/src/main/java/org/apache/doris/clone/DynamicPartitionScheduler.java ## @@ -210,7 +215,8 @@ public void createOrUpdateRuntimeInfo

[GitHub] [incubator-doris] morningman commented on a change in pull request #3679: [DynamicPartition] Optimize the rule of creating dynamic partition

2020-05-25 Thread GitBox
morningman commented on a change in pull request #3679: URL: https://github.com/apache/incubator-doris/pull/3679#discussion_r429860375 ## File path: fe/src/main/java/org/apache/doris/common/util/DynamicPartitionUtil.java ## @@ -273,34 +321,110 @@ public static String getPartit

[GitHub] [incubator-doris] morningman commented on a change in pull request #3679: [DynamicPartition] Optimize the rule of creating dynamic partition

2020-05-25 Thread GitBox
morningman commented on a change in pull request #3679: URL: https://github.com/apache/incubator-doris/pull/3679#discussion_r429859638 ## File path: fe/src/main/java/org/apache/doris/common/util/DynamicPartitionUtil.java ## @@ -273,34 +321,110 @@ public static String getPartit

[GitHub] [incubator-doris] morningman commented on a change in pull request #3679: [DynamicPartition] Optimize the rule of creating dynamic partition

2020-05-25 Thread GitBox
morningman commented on a change in pull request #3679: URL: https://github.com/apache/incubator-doris/pull/3679#discussion_r429859708 ## File path: fe/src/main/java/org/apache/doris/common/util/DynamicPartitionUtil.java ## @@ -273,34 +321,110 @@ public static String getPartit

[GitHub] [incubator-doris] morningman commented on a change in pull request #3679: [DynamicPartition] Optimize the rule of creating dynamic partition

2020-05-25 Thread GitBox
morningman commented on a change in pull request #3679: URL: https://github.com/apache/incubator-doris/pull/3679#discussion_r429859199 ## File path: fe/src/main/java/org/apache/doris/common/util/DynamicPartitionUtil.java ## @@ -114,6 +118,34 @@ private static void checkEnable(

[GitHub] [incubator-doris] morningman commented on a change in pull request #3679: [DynamicPartition] Optimize the rule of creating dynamic partition

2020-05-25 Thread GitBox
morningman commented on a change in pull request #3679: URL: https://github.com/apache/incubator-doris/pull/3679#discussion_r429858691 ## File path: docs/zh-CN/administrator-guide/dynamic-partition.md ## @@ -161,48 +281,26 @@ SHOW DYNAMIC PARTITION TABLES; * dynamic\_partiti

[GitHub] [incubator-doris] morningman commented on a change in pull request #3679: [DynamicPartition] Optimize the rule of creating dynamic partition

2020-05-25 Thread GitBox
morningman commented on a change in pull request #3679: URL: https://github.com/apache/incubator-doris/pull/3679#discussion_r429858538 ## File path: docs/zh-CN/administrator-guide/dynamic-partition.md ## @@ -41,117 +39,239 @@ under the License. 在某些使用场景下,用户会将表按照天进行分区划分,每天定时执

[GitHub] [incubator-doris] morningman commented on a change in pull request #3679: [DynamicPartition] Optimize the rule of creating dynamic partition

2020-05-25 Thread GitBox
morningman commented on a change in pull request #3679: URL: https://github.com/apache/incubator-doris/pull/3679#discussion_r429857971 ## File path: docs/zh-CN/administrator-guide/dynamic-partition.md ## @@ -161,48 +281,26 @@ SHOW DYNAMIC PARTITION TABLES; * dynamic\_partiti

[GitHub] [incubator-doris] WingsGo commented on a change in pull request #3679: [DynamicPartition] Optimize the rule of creating dynamic partition

2020-05-25 Thread GitBox
WingsGo commented on a change in pull request #3679: URL: https://github.com/apache/incubator-doris/pull/3679#discussion_r429854433 ## File path: fe/src/main/java/org/apache/doris/common/util/DynamicPartitionUtil.java ## @@ -273,34 +321,110 @@ public static String getPartition

[GitHub] [incubator-doris] WingsGo commented on a change in pull request #3679: [DynamicPartition] Optimize the rule of creating dynamic partition

2020-05-25 Thread GitBox
WingsGo commented on a change in pull request #3679: URL: https://github.com/apache/incubator-doris/pull/3679#discussion_r429852489 ## File path: fe/src/main/java/org/apache/doris/common/util/DynamicPartitionUtil.java ## @@ -273,34 +321,110 @@ public static String getPartition

[GitHub] [incubator-doris] WingsGo commented on a change in pull request #3679: [DynamicPartition] Optimize the rule of creating dynamic partition

2020-05-25 Thread GitBox
WingsGo commented on a change in pull request #3679: URL: https://github.com/apache/incubator-doris/pull/3679#discussion_r429850385 ## File path: fe/src/main/java/org/apache/doris/common/util/DynamicPartitionUtil.java ## @@ -273,34 +321,110 @@ public static String getPartition

[GitHub] [incubator-doris] acelyc111 commented on issue #3687: [compaction] Cumulative compaction is skipped when a tablet do cumulative compaction the first time

2020-05-25 Thread GitBox
acelyc111 commented on issue #3687: URL: https://github.com/apache/incubator-doris/issues/3687#issuecomment-633494076 https://github.com/apache/incubator-doris/blob/a5922051c9bee4d75599847838596abcd8b0bd3b/be/src/olap/tablet.cpp#L681-L702 I'm not sure how does cumulative point calcu

[GitHub] [incubator-doris] WingsGo commented on a change in pull request #3679: [DynamicPartition] Optimize the rule of creating dynamic partition

2020-05-25 Thread GitBox
WingsGo commented on a change in pull request #3679: URL: https://github.com/apache/incubator-doris/pull/3679#discussion_r429850385 ## File path: fe/src/main/java/org/apache/doris/common/util/DynamicPartitionUtil.java ## @@ -273,34 +321,110 @@ public static String getPartition

[GitHub] [incubator-doris] acelyc111 opened a new issue #3687: [compaction] Cumulative compaction is skipped when a tablet do cumulative compaction the first time

2020-05-25 Thread GitBox
acelyc111 opened a new issue #3687: URL: https://github.com/apache/incubator-doris/issues/3687 **Describe the bug** When a tablet cumulate many rowsets and is picked to do cumulative compaction for the first time, cumulative compaction will be skipped, cumulative point will move from -1

[GitHub] [incubator-doris] EmmyMiao87 opened a new pull request #3686: [Bug] Serialize storage format in rollup job

2020-05-25 Thread GitBox
EmmyMiao87 opened a new pull request #3686: URL: https://github.com/apache/incubator-doris/pull/3686 The segment v2 rollup job should set the storage format v2 and serialize it. If it is not serialized, the rollup of segment v2 may use the error format 'segment v1'. Change-Id: I2c

[GitHub] [incubator-doris] wutiangan commented on a change in pull request #3676: [Stmt] Add rowCount column to SHOW DATA stmt

2020-05-25 Thread GitBox
wutiangan commented on a change in pull request #3676: URL: https://github.com/apache/incubator-doris/pull/3676#discussion_r429816590 ## File path: docs/en/sql-reference/sql-statements/Data Manipulation/SHOW DATA.md ## @@ -25,22 +25,62 @@ under the License. --> # SHOW DATA

[GitHub] [incubator-doris] chaoyli commented on pull request #3637: [Memory Engine] Add MemSubTablet, MemTablet, WriteTx, PartialRowBatch

2020-05-25 Thread GitBox
chaoyli commented on pull request #3637: URL: https://github.com/apache/incubator-doris/pull/3637#issuecomment-633460801 LGTM This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [incubator-doris] wutiangan commented on a change in pull request #3679: [DynamicPartition] Optimize the rule of creating dynamic partition

2020-05-25 Thread GitBox
wutiangan commented on a change in pull request #3679: URL: https://github.com/apache/incubator-doris/pull/3679#discussion_r429810367 ## File path: fe/src/main/java/org/apache/doris/common/util/DynamicPartitionUtil.java ## @@ -273,34 +321,110 @@ public static String getPartiti

[GitHub] [incubator-doris] wutiangan commented on a change in pull request #3679: [DynamicPartition] Optimize the rule of creating dynamic partition

2020-05-25 Thread GitBox
wutiangan commented on a change in pull request #3679: URL: https://github.com/apache/incubator-doris/pull/3679#discussion_r429809541 ## File path: fe/src/main/java/org/apache/doris/common/util/DynamicPartitionUtil.java ## @@ -273,34 +321,110 @@ public static String getPartiti

[GitHub] [incubator-doris] hffariel opened a new pull request #3685: [Enhancement] Customize the style of sidebar (branch-0.11)

2020-05-25 Thread GitBox
hffariel opened a new pull request #3685: URL: https://github.com/apache/incubator-doris/pull/3685 Override the style of sidebar's sub-directory. (#3595) This is an automated message from the Apache Git Service. To respond to

[GitHub] [incubator-doris] hffariel opened a new pull request #3684: [Enhancement] Customize the style of sidebar (branch-0.12)

2020-05-25 Thread GitBox
hffariel opened a new pull request #3684: URL: https://github.com/apache/incubator-doris/pull/3684 Override the style of sidebar's sub-directory. (#3595) This is an automated message from the Apache Git Service. To respond to

[GitHub] [incubator-doris] hffariel opened a new pull request #3683: [Enhancement] Customize the style of sidebar (master)

2020-05-25 Thread GitBox
hffariel opened a new pull request #3683: URL: https://github.com/apache/incubator-doris/pull/3683 Override the style of sidebar's sub-directory. (#3595) This is an automated message from the Apache Git Service. To respond to

[GitHub] [incubator-doris] WingsGo commented on a change in pull request #3679: [DynamicPartition] Optimize the rule of creating dynamic partition

2020-05-25 Thread GitBox
WingsGo commented on a change in pull request #3679: URL: https://github.com/apache/incubator-doris/pull/3679#discussion_r429805830 ## File path: fe/src/main/java/org/apache/doris/common/util/DynamicPartitionUtil.java ## @@ -114,6 +118,34 @@ private static void checkEnable(Str

[GitHub] [incubator-doris] chaoyli commented on pull request #3649: [bug] init be log file length when restart be

2020-05-25 Thread GitBox
chaoyli commented on pull request #3649: URL: https://github.com/apache/incubator-doris/pull/3649#issuecomment-633451143 LGTM This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [incubator-doris] wutiangan commented on a change in pull request #3679: [DynamicPartition] Optimize the rule of creating dynamic partition

2020-05-25 Thread GitBox
wutiangan commented on a change in pull request #3679: URL: https://github.com/apache/incubator-doris/pull/3679#discussion_r429804756 ## File path: docs/zh-CN/administrator-guide/dynamic-partition.md ## @@ -161,48 +281,26 @@ SHOW DYNAMIC PARTITION TABLES; * dynamic\_partitio

[GitHub] [incubator-doris] wutiangan commented on a change in pull request #3679: [DynamicPartition] Optimize the rule of creating dynamic partition

2020-05-25 Thread GitBox
wutiangan commented on a change in pull request #3679: URL: https://github.com/apache/incubator-doris/pull/3679#discussion_r429803209 ## File path: docs/zh-CN/administrator-guide/dynamic-partition.md ## @@ -41,117 +39,239 @@ under the License. 在某些使用场景下,用户会将表按照天进行分区划分,每天定时执行

[GitHub] [incubator-doris] wenbronk opened a new issue #3682: [routine load] kafka routine load 可以读取到事务已经abort了的消息

2020-05-25 Thread GitBox
wenbronk opened a new issue #3682: URL: https://github.com/apache/incubator-doris/issues/3682 使用kafka routine load 从kafka往routine中导入数据, 新建导入任务如下 ```mysql CREATE ROUTINE LOAD access_kafka ON access_log COLUMNS TERMINATED BY "|", COLUMNS( `domain_id` , `datetime` ,

[GitHub] [incubator-doris] wutiangan commented on a change in pull request #3679: [DynamicPartition] Optimize the rule of creating dynamic partition

2020-05-25 Thread GitBox
wutiangan commented on a change in pull request #3679: URL: https://github.com/apache/incubator-doris/pull/3679#discussion_r429803209 ## File path: docs/zh-CN/administrator-guide/dynamic-partition.md ## @@ -41,117 +39,239 @@ under the License. 在某些使用场景下,用户会将表按照天进行分区划分,每天定时执行

[GitHub] [incubator-doris] WingsGo commented on a change in pull request #3679: [DynamicPartition] Optimize the rule of creating dynamic partition

2020-05-25 Thread GitBox
WingsGo commented on a change in pull request #3679: URL: https://github.com/apache/incubator-doris/pull/3679#discussion_r429800488 ## File path: docs/zh-CN/administrator-guide/dynamic-partition.md ## @@ -161,48 +281,26 @@ SHOW DYNAMIC PARTITION TABLES; * dynamic\_partition\

[GitHub] [incubator-doris] morningman commented on a change in pull request #3584: [OUTFILE] Support `INTO OUTFILE` to export query result

2020-05-25 Thread GitBox
morningman commented on a change in pull request #3584: URL: https://github.com/apache/incubator-doris/pull/3584#discussion_r429788998 ## File path: be/src/runtime/query_statistics.h ## @@ -71,6 +77,9 @@ class QueryStatistics { int64_t scan_rows; int64_t scan_bytes;

[GitHub] [incubator-doris] morningman opened a new pull request #3681: [AuditPlugin] Modify load label of audit plugin to avoid load confliction

2020-05-25 Thread GitBox
morningman opened a new pull request #3681: URL: https://github.com/apache/incubator-doris/pull/3681 Fix #3680 Change the load label of audit plugin as: `audit_MMdd_HHmmss_feIdentity`. The `feIdentity` is got from the FE which run this plugin, currently just use FE

[GitHub] [incubator-doris] morningman opened a new issue #3680: [AuditPlugin] Conflict load label from different FE

2020-05-25 Thread GitBox
morningman opened a new issue #3680: URL: https://github.com/apache/incubator-doris/issues/3680 **Describe the bug** the audit plugin is running on different FE, but currently the format of load label is all same, like: `audit_20200425_033418` This will cause label conflict