[incubator-doris] branch master updated: 1. Delete the code of Sort Node we do not use now. (#3666)

2020-05-25 Thread lichaoyong
This is an automated email from the ASF dual-hosted git repository. lichaoyong pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-doris.git The following commit(s) were added to refs/heads/master by this push: new f4c03fe 1. Delete the code of

[incubator-doris] branch branch-0.12 updated: Override the style of sidebar's sub-direcotry (#3684)

2020-05-25 Thread zhaoc
This is an automated email from the ASF dual-hosted git repository. zhaoc pushed a commit to branch branch-0.12 in repository https://gitbox.apache.org/repos/asf/incubator-doris.git The following commit(s) were added to refs/heads/branch-0.12 by this push: new 2252649 Override the style

[incubator-doris] branch master updated (3ffc447 -> 963d4d4)

2020-05-25 Thread zhaoc
This is an automated email from the ASF dual-hosted git repository. zhaoc pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/incubator-doris.git. from 3ffc447 [OUTFILE] Support `INTO OUTFILE` to export query result (#3584) add 963d4d4 Override the

[incubator-doris] branch branch-0.11 updated: Override the style of sidebar's sub-direcotry (#3685)

2020-05-25 Thread zhaoc
This is an automated email from the ASF dual-hosted git repository. zhaoc pushed a commit to branch branch-0.11 in repository https://gitbox.apache.org/repos/asf/incubator-doris.git The following commit(s) were added to refs/heads/branch-0.11 by this push: new f463fbe Override the style

[GitHub] [incubator-doris] morningman commented on a change in pull request #3679: [DynamicPartition] Optimize the rule of creating dynamic partition

2020-05-25 Thread GitBox
morningman commented on a change in pull request #3679: URL: https://github.com/apache/incubator-doris/pull/3679#discussion_r429937221 ## File path: fe/src/main/java/org/apache/doris/clone/DynamicPartitionScheduler.java ## @@ -210,7 +215,8 @@ public void

[GitHub] [incubator-doris] morningman commented on a change in pull request #3679: [DynamicPartition] Optimize the rule of creating dynamic partition

2020-05-25 Thread GitBox
morningman commented on a change in pull request #3679: URL: https://github.com/apache/incubator-doris/pull/3679#discussion_r429936606 ## File path: fe/src/main/java/org/apache/doris/clone/DynamicPartitionScheduler.java ## @@ -275,19 +280,25 @@ private void

[GitHub] [incubator-doris] EmmyMiao87 commented on pull request #3686: [Bug] Serialize storage format in rollup job

2020-05-25 Thread GitBox
EmmyMiao87 commented on pull request #3686: URL: https://github.com/apache/incubator-doris/pull/3686#issuecomment-633572709 > @EmmyMiao87 Hi, Please add a UT to cover RollupJobV2 Serde. Thanks. Added This is an

[GitHub] [incubator-doris] morningman merged pull request #3584: [OUTFILE] Support `INTO OUTFILE` to export query result

2020-05-25 Thread GitBox
morningman merged pull request #3584: URL: https://github.com/apache/incubator-doris/pull/3584 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[incubator-doris] branch master updated (6788cac -> 3ffc447)

2020-05-25 Thread morningman
This is an automated email from the ASF dual-hosted git repository. morningman pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/incubator-doris.git. from 6788cac Fix unit test failed (#3642) add 3ffc447 [OUTFILE] Support `INTO OUTFILE` to export

[GitHub] [incubator-doris] kangkaisen commented on pull request #3686: [Bug] Serialize storage format in rollup job

2020-05-25 Thread GitBox
kangkaisen commented on pull request #3686: URL: https://github.com/apache/incubator-doris/pull/3686#issuecomment-633547441 @EmmyMiao87 Hi, Please add a UT to cover RollupJobV2 Serde. Thanks. This is an automated message

[GitHub] [incubator-doris] chaoyli edited a comment on pull request #3635: [Enhancement] Convert metric to Json format

2020-05-25 Thread GitBox
chaoyli edited a comment on pull request #3635: URL: https://github.com/apache/incubator-doris/pull/3635#issuecomment-633538300 > > > Why we need a json format metric output? > > > > > > It's for incorporating another Monitor Tools easily. Json will be a good choice for this

[GitHub] [incubator-doris] chaoyli commented on pull request #3635: [Enhancement] Convert metric to Json format

2020-05-25 Thread GitBox
chaoyli commented on pull request #3635: URL: https://github.com/apache/incubator-doris/pull/3635#issuecomment-633538300 > > > Why we need a json format metric output? > > > > > > It's for incorporating another Monitor Tools easily. Json will be a good choice for this demand.

[GitHub] [incubator-doris] WingsGo commented on a change in pull request #3679: [DynamicPartition] Optimize the rule of creating dynamic partition

2020-05-25 Thread GitBox
WingsGo commented on a change in pull request #3679: URL: https://github.com/apache/incubator-doris/pull/3679#discussion_r429897947 ## File path: fe/src/main/java/org/apache/doris/common/util/DynamicPartitionUtil.java ## @@ -114,6 +118,34 @@ private static void

[GitHub] [incubator-doris] WingsGo commented on a change in pull request #3679: [DynamicPartition] Optimize the rule of creating dynamic partition

2020-05-25 Thread GitBox
WingsGo commented on a change in pull request #3679: URL: https://github.com/apache/incubator-doris/pull/3679#discussion_r429897271 ## File path: fe/src/main/java/org/apache/doris/clone/DynamicPartitionScheduler.java ## @@ -275,19 +280,25 @@ private void

[GitHub] [incubator-doris] WingsGo commented on a change in pull request #3679: [DynamicPartition] Optimize the rule of creating dynamic partition

2020-05-25 Thread GitBox
WingsGo commented on a change in pull request #3679: URL: https://github.com/apache/incubator-doris/pull/3679#discussion_r429896775 ## File path: fe/src/main/java/org/apache/doris/clone/DynamicPartitionScheduler.java ## @@ -149,10 +148,11 @@ public void

[GitHub] [incubator-doris] WingsGo commented on a change in pull request #3679: [DynamicPartition] Optimize the rule of creating dynamic partition

2020-05-25 Thread GitBox
WingsGo commented on a change in pull request #3679: URL: https://github.com/apache/incubator-doris/pull/3679#discussion_r429885387 ## File path: fe/src/main/java/org/apache/doris/common/util/DynamicPartitionUtil.java ## @@ -273,34 +321,110 @@ public static String

[GitHub] [incubator-doris] sduzh opened a new issue #3688: Query with a cast in where clause returned wrong result

2020-05-25 Thread GitBox
sduzh opened a new issue #3688: URL: https://github.com/apache/incubator-doris/issues/3688 **Describe the bug** If there are `cast` statements in where clause, a wrong result may be returned. **To Reproduce** ``` create table t1(k bigint not null) DISTRIBUTED BY HASH(k)

[GitHub] [incubator-doris] WingsGo commented on a change in pull request #3679: [DynamicPartition] Optimize the rule of creating dynamic partition

2020-05-25 Thread GitBox
WingsGo commented on a change in pull request #3679: URL: https://github.com/apache/incubator-doris/pull/3679#discussion_r429878339 ## File path: fe/src/main/java/org/apache/doris/common/util/DynamicPartitionUtil.java ## @@ -273,34 +321,110 @@ public static String

[GitHub] [incubator-doris] WingsGo commented on a change in pull request #3679: [DynamicPartition] Optimize the rule of creating dynamic partition

2020-05-25 Thread GitBox
WingsGo commented on a change in pull request #3679: URL: https://github.com/apache/incubator-doris/pull/3679#discussion_r429878339 ## File path: fe/src/main/java/org/apache/doris/common/util/DynamicPartitionUtil.java ## @@ -273,34 +321,110 @@ public static String

[incubator-doris] branch master updated: Fix unit test failed (#3642)

2020-05-25 Thread zhaoc
This is an automated email from the ASF dual-hosted git repository. zhaoc pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-doris.git The following commit(s) were added to refs/heads/master by this push: new 6788cac Fix unit test failed (#3642)

[GitHub] [incubator-doris] imay merged pull request #3642: Fix some unit test failed

2020-05-25 Thread GitBox
imay merged pull request #3642: URL: https://github.com/apache/incubator-doris/pull/3642 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [incubator-doris] WingsGo commented on pull request #3527: [SQL]When compare StringLiteral and Numerical, cast them to Numerical type

2020-05-25 Thread GitBox
WingsGo commented on pull request #3527: URL: https://github.com/apache/incubator-doris/pull/3527#issuecomment-633509376 Hi, @morningman @imay , this PR is ready for review This is an automated message from the Apache Git

[GitHub] [incubator-doris] WingsGo commented on a change in pull request #3679: [DynamicPartition] Optimize the rule of creating dynamic partition

2020-05-25 Thread GitBox
WingsGo commented on a change in pull request #3679: URL: https://github.com/apache/incubator-doris/pull/3679#discussion_r429862055 ## File path: fe/src/main/java/org/apache/doris/clone/DynamicPartitionScheduler.java ## @@ -210,7 +215,8 @@ public void

[GitHub] [incubator-doris] morningman commented on a change in pull request #3679: [DynamicPartition] Optimize the rule of creating dynamic partition

2020-05-25 Thread GitBox
morningman commented on a change in pull request #3679: URL: https://github.com/apache/incubator-doris/pull/3679#discussion_r429860375 ## File path: fe/src/main/java/org/apache/doris/common/util/DynamicPartitionUtil.java ## @@ -273,34 +321,110 @@ public static String

[GitHub] [incubator-doris] morningman commented on a change in pull request #3679: [DynamicPartition] Optimize the rule of creating dynamic partition

2020-05-25 Thread GitBox
morningman commented on a change in pull request #3679: URL: https://github.com/apache/incubator-doris/pull/3679#discussion_r429859638 ## File path: fe/src/main/java/org/apache/doris/common/util/DynamicPartitionUtil.java ## @@ -273,34 +321,110 @@ public static String

[GitHub] [incubator-doris] morningman commented on a change in pull request #3679: [DynamicPartition] Optimize the rule of creating dynamic partition

2020-05-25 Thread GitBox
morningman commented on a change in pull request #3679: URL: https://github.com/apache/incubator-doris/pull/3679#discussion_r429859708 ## File path: fe/src/main/java/org/apache/doris/common/util/DynamicPartitionUtil.java ## @@ -273,34 +321,110 @@ public static String

[GitHub] [incubator-doris] morningman commented on a change in pull request #3679: [DynamicPartition] Optimize the rule of creating dynamic partition

2020-05-25 Thread GitBox
morningman commented on a change in pull request #3679: URL: https://github.com/apache/incubator-doris/pull/3679#discussion_r429859199 ## File path: fe/src/main/java/org/apache/doris/common/util/DynamicPartitionUtil.java ## @@ -114,6 +118,34 @@ private static void

[GitHub] [incubator-doris] morningman commented on a change in pull request #3679: [DynamicPartition] Optimize the rule of creating dynamic partition

2020-05-25 Thread GitBox
morningman commented on a change in pull request #3679: URL: https://github.com/apache/incubator-doris/pull/3679#discussion_r429858691 ## File path: docs/zh-CN/administrator-guide/dynamic-partition.md ## @@ -161,48 +281,26 @@ SHOW DYNAMIC PARTITION TABLES; *

[GitHub] [incubator-doris] morningman commented on a change in pull request #3679: [DynamicPartition] Optimize the rule of creating dynamic partition

2020-05-25 Thread GitBox
morningman commented on a change in pull request #3679: URL: https://github.com/apache/incubator-doris/pull/3679#discussion_r429858538 ## File path: docs/zh-CN/administrator-guide/dynamic-partition.md ## @@ -41,117 +39,239 @@ under the License.

[GitHub] [incubator-doris] morningman commented on a change in pull request #3679: [DynamicPartition] Optimize the rule of creating dynamic partition

2020-05-25 Thread GitBox
morningman commented on a change in pull request #3679: URL: https://github.com/apache/incubator-doris/pull/3679#discussion_r429857971 ## File path: docs/zh-CN/administrator-guide/dynamic-partition.md ## @@ -161,48 +281,26 @@ SHOW DYNAMIC PARTITION TABLES; *

[GitHub] [incubator-doris] WingsGo commented on a change in pull request #3679: [DynamicPartition] Optimize the rule of creating dynamic partition

2020-05-25 Thread GitBox
WingsGo commented on a change in pull request #3679: URL: https://github.com/apache/incubator-doris/pull/3679#discussion_r429854433 ## File path: fe/src/main/java/org/apache/doris/common/util/DynamicPartitionUtil.java ## @@ -273,34 +321,110 @@ public static String

[GitHub] [incubator-doris] WingsGo commented on a change in pull request #3679: [DynamicPartition] Optimize the rule of creating dynamic partition

2020-05-25 Thread GitBox
WingsGo commented on a change in pull request #3679: URL: https://github.com/apache/incubator-doris/pull/3679#discussion_r429852489 ## File path: fe/src/main/java/org/apache/doris/common/util/DynamicPartitionUtil.java ## @@ -273,34 +321,110 @@ public static String

[GitHub] [incubator-doris] WingsGo commented on a change in pull request #3679: [DynamicPartition] Optimize the rule of creating dynamic partition

2020-05-25 Thread GitBox
WingsGo commented on a change in pull request #3679: URL: https://github.com/apache/incubator-doris/pull/3679#discussion_r429850385 ## File path: fe/src/main/java/org/apache/doris/common/util/DynamicPartitionUtil.java ## @@ -273,34 +321,110 @@ public static String

[GitHub] [incubator-doris] acelyc111 commented on issue #3687: [compaction] Cumulative compaction is skipped when a tablet do cumulative compaction the first time

2020-05-25 Thread GitBox
acelyc111 commented on issue #3687: URL: https://github.com/apache/incubator-doris/issues/3687#issuecomment-633494076 https://github.com/apache/incubator-doris/blob/a5922051c9bee4d75599847838596abcd8b0bd3b/be/src/olap/tablet.cpp#L681-L702 I'm not sure how does cumulative point

[GitHub] [incubator-doris] WingsGo commented on a change in pull request #3679: [DynamicPartition] Optimize the rule of creating dynamic partition

2020-05-25 Thread GitBox
WingsGo commented on a change in pull request #3679: URL: https://github.com/apache/incubator-doris/pull/3679#discussion_r429850385 ## File path: fe/src/main/java/org/apache/doris/common/util/DynamicPartitionUtil.java ## @@ -273,34 +321,110 @@ public static String

[GitHub] [incubator-doris] acelyc111 opened a new issue #3687: [compaction] Cumulative compaction is skipped when a tablet do cumulative compaction the first time

2020-05-25 Thread GitBox
acelyc111 opened a new issue #3687: URL: https://github.com/apache/incubator-doris/issues/3687 **Describe the bug** When a tablet cumulate many rowsets and is picked to do cumulative compaction for the first time, cumulative compaction will be skipped, cumulative point will move from

[GitHub] [incubator-doris] EmmyMiao87 opened a new pull request #3686: [Bug] Serialize storage format in rollup job

2020-05-25 Thread GitBox
EmmyMiao87 opened a new pull request #3686: URL: https://github.com/apache/incubator-doris/pull/3686 The segment v2 rollup job should set the storage format v2 and serialize it. If it is not serialized, the rollup of segment v2 may use the error format 'segment v1'. Change-Id:

[GitHub] [incubator-doris] wutiangan commented on a change in pull request #3676: [Stmt] Add rowCount column to SHOW DATA stmt

2020-05-25 Thread GitBox
wutiangan commented on a change in pull request #3676: URL: https://github.com/apache/incubator-doris/pull/3676#discussion_r429816590 ## File path: docs/en/sql-reference/sql-statements/Data Manipulation/SHOW DATA.md ## @@ -25,22 +25,62 @@ under the License. --> # SHOW DATA

[GitHub] [incubator-doris] chaoyli commented on pull request #3637: [Memory Engine] Add MemSubTablet, MemTablet, WriteTx, PartialRowBatch

2020-05-25 Thread GitBox
chaoyli commented on pull request #3637: URL: https://github.com/apache/incubator-doris/pull/3637#issuecomment-633460801 LGTM This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [incubator-doris] wutiangan commented on a change in pull request #3679: [DynamicPartition] Optimize the rule of creating dynamic partition

2020-05-25 Thread GitBox
wutiangan commented on a change in pull request #3679: URL: https://github.com/apache/incubator-doris/pull/3679#discussion_r429810367 ## File path: fe/src/main/java/org/apache/doris/common/util/DynamicPartitionUtil.java ## @@ -273,34 +321,110 @@ public static String

[GitHub] [incubator-doris] wutiangan commented on a change in pull request #3679: [DynamicPartition] Optimize the rule of creating dynamic partition

2020-05-25 Thread GitBox
wutiangan commented on a change in pull request #3679: URL: https://github.com/apache/incubator-doris/pull/3679#discussion_r429809541 ## File path: fe/src/main/java/org/apache/doris/common/util/DynamicPartitionUtil.java ## @@ -273,34 +321,110 @@ public static String

[GitHub] [incubator-doris] hffariel opened a new pull request #3685: [Enhancement] Customize the style of sidebar (branch-0.11)

2020-05-25 Thread GitBox
hffariel opened a new pull request #3685: URL: https://github.com/apache/incubator-doris/pull/3685 Override the style of sidebar's sub-directory. (#3595) This is an automated message from the Apache Git Service. To respond

[GitHub] [incubator-doris] hffariel opened a new pull request #3684: [Enhancement] Customize the style of sidebar (branch-0.12)

2020-05-25 Thread GitBox
hffariel opened a new pull request #3684: URL: https://github.com/apache/incubator-doris/pull/3684 Override the style of sidebar's sub-directory. (#3595) This is an automated message from the Apache Git Service. To respond

[GitHub] [incubator-doris] hffariel opened a new pull request #3683: [Enhancement] Customize the style of sidebar (master)

2020-05-25 Thread GitBox
hffariel opened a new pull request #3683: URL: https://github.com/apache/incubator-doris/pull/3683 Override the style of sidebar's sub-directory. (#3595) This is an automated message from the Apache Git Service. To respond

[GitHub] [incubator-doris] WingsGo commented on a change in pull request #3679: [DynamicPartition] Optimize the rule of creating dynamic partition

2020-05-25 Thread GitBox
WingsGo commented on a change in pull request #3679: URL: https://github.com/apache/incubator-doris/pull/3679#discussion_r429805830 ## File path: fe/src/main/java/org/apache/doris/common/util/DynamicPartitionUtil.java ## @@ -114,6 +118,34 @@ private static void

[GitHub] [incubator-doris] chaoyli commented on pull request #3649: [bug] init be log file length when restart be

2020-05-25 Thread GitBox
chaoyli commented on pull request #3649: URL: https://github.com/apache/incubator-doris/pull/3649#issuecomment-633451143 LGTM This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [incubator-doris] wutiangan commented on a change in pull request #3679: [DynamicPartition] Optimize the rule of creating dynamic partition

2020-05-25 Thread GitBox
wutiangan commented on a change in pull request #3679: URL: https://github.com/apache/incubator-doris/pull/3679#discussion_r429804756 ## File path: docs/zh-CN/administrator-guide/dynamic-partition.md ## @@ -161,48 +281,26 @@ SHOW DYNAMIC PARTITION TABLES; *

[GitHub] [incubator-doris] wutiangan commented on a change in pull request #3679: [DynamicPartition] Optimize the rule of creating dynamic partition

2020-05-25 Thread GitBox
wutiangan commented on a change in pull request #3679: URL: https://github.com/apache/incubator-doris/pull/3679#discussion_r429803209 ## File path: docs/zh-CN/administrator-guide/dynamic-partition.md ## @@ -41,117 +39,239 @@ under the License.

[GitHub] [incubator-doris] wenbronk opened a new issue #3682: [routine load] kafka routine load 可以读取到事务已经abort了的消息

2020-05-25 Thread GitBox
wenbronk opened a new issue #3682: URL: https://github.com/apache/incubator-doris/issues/3682 使用kafka routine load 从kafka往routine中导入数据, 新建导入任务如下 ```mysql CREATE ROUTINE LOAD access_kafka ON access_log COLUMNS TERMINATED BY "|", COLUMNS( `domain_id` , `datetime` ,

[GitHub] [incubator-doris] wutiangan commented on a change in pull request #3679: [DynamicPartition] Optimize the rule of creating dynamic partition

2020-05-25 Thread GitBox
wutiangan commented on a change in pull request #3679: URL: https://github.com/apache/incubator-doris/pull/3679#discussion_r429803209 ## File path: docs/zh-CN/administrator-guide/dynamic-partition.md ## @@ -41,117 +39,239 @@ under the License.

[GitHub] [incubator-doris] WingsGo commented on a change in pull request #3679: [DynamicPartition] Optimize the rule of creating dynamic partition

2020-05-25 Thread GitBox
WingsGo commented on a change in pull request #3679: URL: https://github.com/apache/incubator-doris/pull/3679#discussion_r429800488 ## File path: docs/zh-CN/administrator-guide/dynamic-partition.md ## @@ -161,48 +281,26 @@ SHOW DYNAMIC PARTITION TABLES; *

[GitHub] [incubator-doris] morningman commented on a change in pull request #3584: [OUTFILE] Support `INTO OUTFILE` to export query result

2020-05-25 Thread GitBox
morningman commented on a change in pull request #3584: URL: https://github.com/apache/incubator-doris/pull/3584#discussion_r429788998 ## File path: be/src/runtime/query_statistics.h ## @@ -71,6 +77,9 @@ class QueryStatistics { int64_t scan_rows; int64_t

[GitHub] [incubator-doris] morningman opened a new pull request #3681: [AuditPlugin] Modify load label of audit plugin to avoid load confliction

2020-05-25 Thread GitBox
morningman opened a new pull request #3681: URL: https://github.com/apache/incubator-doris/pull/3681 Fix #3680 Change the load label of audit plugin as: `audit_MMdd_HHmmss_feIdentity`. The `feIdentity` is got from the FE which run this plugin, currently just use

[GitHub] [incubator-doris] morningman opened a new issue #3680: [AuditPlugin] Conflict load label from different FE

2020-05-25 Thread GitBox
morningman opened a new issue #3680: URL: https://github.com/apache/incubator-doris/issues/3680 **Describe the bug** the audit plugin is running on different FE, but currently the format of load label is all same, like: `audit_20200425_033418` This will cause label

[GitHub] [incubator-doris] morningman opened a new pull request #3679: [DynamicPartition] Optimize the rule of creating dynamic partition

2020-05-25 Thread GitBox
morningman opened a new pull request #3679: URL: https://github.com/apache/incubator-doris/pull/3679 Problem is described in ISSUE #3678 This CL mainly changed to rule of creating dynamic partition. 1. If time unit is DAY, the logic remains unchanged. 2. If time unit is WEEK,

[GitHub] [incubator-doris] morningman opened a new issue #3678: [DynamicPartition] Dynamic partition range always intersect with existing partition's.

2020-05-25 Thread GitBox
morningman opened a new issue #3678: URL: https://github.com/apache/incubator-doris/issues/3678 **Describe the bug** In our cluster, we found a lot warning log in Master fe.log ``` 2020-05-25 14:33:06,763 WARN 44 [DynamicPartitionScheduler.recordCreatePartitionFailedMsg():324]