Re: [PR] [test](mtmv)add create partition and partition scrolling [doris]

2024-12-04 Thread via GitHub


zfr9527 commented on PR #44797:
URL: https://github.com/apache/doris/pull/44797#issuecomment-2516571588

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [test](mtmv)add create partition and partition scrolling [doris]

2024-12-02 Thread via GitHub


zfr9527 closed pull request #43455: [test](mtmv)add create partition and 
partition scrolling
URL: https://github.com/apache/doris/pull/43455


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [test](mtmv)add create partition and partition scrolling [doris]

2024-12-02 Thread via GitHub


zfr9527 commented on PR #44797:
URL: https://github.com/apache/doris/pull/44797#issuecomment-2510936750

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [test](mtmv)add create partition and partition scrolling [doris]

2024-11-29 Thread via GitHub


zfr9527 commented on PR #44797:
URL: https://github.com/apache/doris/pull/44797#issuecomment-2507714585

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [test](mtmv)add create partition and partition scrolling [doris]

2024-11-29 Thread via GitHub


doris-robot commented on PR #44797:
URL: https://github.com/apache/doris/pull/44797#issuecomment-2507714469

   
   Thank you for your contribution to Apache Doris.
   Don't know what should be done next? See [How to process your 
PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR).
   
   Please clearly describe your PR:
   1. What problem was fixed (it's best to include specific error reporting 
information). How it was fixed.
   2. Which behaviors were modified. What was the previous behavior, what is it 
now, why was it modified, and what possible impacts might there be.
   3. What features were added. Why was this function added?
   4. Which code was refactored and why was this part of the code refactored?
   5. Which functions were optimized and what is the difference before and 
after the optimization?
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[PR] [test](mtmv)add create partition and partition scrolling [doris]

2024-11-29 Thread via GitHub


zfr9527 opened a new pull request, #44797:
URL: https://github.com/apache/doris/pull/44797

   pick from #42402 
   
   [test](mtmv)add create partition and partition scrolling
   
   ### What problem does this PR solve?
   
   Issue Number: close #xxx
   
   Related PR: #xxx
   
   Problem Summary:
   
   ### Release note
   
   None
   
   ### Check List (For Author)
   
   - Test 
   - [ ] Regression test
   - [ ] Unit Test
   - [ ] Manual test (add detailed scripts or steps below)
   - [ ] No need to test or manual test. Explain why:
   - [ ] This is a refactor/code format and no logic has been changed.
   - [ ] Previous test can cover this change.
   - [ ] No code files have been changed.
   - [ ] Other reason 
   
   - Behavior changed:
   - [ ] No.
   - [ ] Yes. 
   
   - Does this need documentation?
   - [ ] No.
   - [ ] Yes. 
   
   ### Check List (For Reviewer who merge this PR)
   
   - [ ] Confirm the release note
   - [ ] Confirm test cases
   - [ ] Confirm document
   - [ ] Add branch pick label 
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [test](mtmv)add create partition and partition scrolling [doris]

2024-11-13 Thread via GitHub


zfr9527 closed pull request #43453: [test](mtmv)add create partition and 
partition scrolling
URL: https://github.com/apache/doris/pull/43453


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [test](mtmv)add create partition and partition scrolling [doris]

2024-11-13 Thread via GitHub


zfr9527 commented on PR #43453:
URL: https://github.com/apache/doris/pull/43453#issuecomment-2473476439

   Version 2.0 does not support the mtmv function


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [test](mtmv)add create partition and partition scrolling [doris]

2024-11-13 Thread via GitHub


zfr9527 commented on PR #43455:
URL: https://github.com/apache/doris/pull/43455#issuecomment-2473409410

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [test](mtmv)add create partition and partition scrolling [doris]

2024-11-13 Thread via GitHub


zfr9527 commented on PR #43455:
URL: https://github.com/apache/doris/pull/43455#issuecomment-2473027744

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [test](mtmv)add create partition and partition scrolling [doris]

2024-11-13 Thread via GitHub


zfr9527 commented on PR #43455:
URL: https://github.com/apache/doris/pull/43455#issuecomment-2473026868

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [test](mtmv)add create partition and partition scrolling [doris]

2024-11-10 Thread via GitHub


yiguolei commented on PR #43453:
URL: https://github.com/apache/doris/pull/43453#issuecomment-2466678059

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [test](mtmv)add create partition and partition scrolling [doris]

2024-11-07 Thread via GitHub


doris-robot commented on PR #43453:
URL: https://github.com/apache/doris/pull/43453#issuecomment-2462101729

   
   Thank you for your contribution to Apache Doris.
   Don't know what should be done next? See [How to process your 
PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR).
   
   ### Check List (For Author)
   
   - Test 
   
   - [ ] Regression test
   - [ ] Unit Test
   - [ ] Manual test (add detailed scripts or steps below)
   - [ ] No need to test or manual test. Explain why:
   - [ ] This is a refactor/code format and no logic has been changed.
   - [ ] Previous test can cover this change.
   - [ ] No code files have been changed.
   - [ ] Other reason 
   
   - Behavior changed:
   
   - [ ] No.
   - [ ] Yes. 
   
   - Does this need documentation?
   
   - [ ] No.
   - [ ] Yes. 
   
   - Release note
   
   
   
   None
   
   ### Check List (For Reviewer who merge this PR)
   
   - [ ] Confirm the release note
   - [ ] Confirm test cases
   - [ ] Confirm document
   - [ ] Add branch pick label 
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[PR] [test](mtmv)add create partition and partition scrolling [doris]

2024-11-07 Thread via GitHub


zfr9527 opened a new pull request, #43453:
URL: https://github.com/apache/doris/pull/43453

   ### What problem does this PR solve?
   
   pick from #42402 
   
   [test](mtmv)add create partition and partition scrolling
   
   
   
   
   Issue Number: close #xxx
   
   
   Related PR: #xxx
   
   Problem Summary:
   
   ### Check List (For Author)
   
   - Test 
   
   - [ ] Regression test
   - [ ] Unit Test
   - [ ] Manual test (add detailed scripts or steps below)
   - [ ] No need to test or manual test. Explain why:
   - [ ] This is a refactor/code format and no logic has been changed.
   - [ ] Previous test can cover this change.
   - [ ] No colde files have been changed.
   - [ ] Other reason 
   
   - Behavior changed:
   
   - [ ] No.
   - [ ] Yes. 
   
   - Does this need documentation?
   
   - [ ] No.
   - [ ] Yes. 
   
   - Release note
   
   
   
   None
   
   ### Check List (For Reviewer who merge this PR)
   
   - [ ] Confirm the release note
   - [ ] Confirm test cases
   - [ ] Confirm document
   - [ ] Add branch pick label 
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [test](mtmv)add create partition and partition scrolling [doris]

2024-11-07 Thread via GitHub


doris-robot commented on PR #43455:
URL: https://github.com/apache/doris/pull/43455#issuecomment-2462107715

   
   Thank you for your contribution to Apache Doris.
   Don't know what should be done next? See [How to process your 
PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR).
   
   ### Check List (For Author)
   
   - Test 
   
   - [ ] Regression test
   - [ ] Unit Test
   - [ ] Manual test (add detailed scripts or steps below)
   - [ ] No need to test or manual test. Explain why:
   - [ ] This is a refactor/code format and no logic has been changed.
   - [ ] Previous test can cover this change.
   - [ ] No code files have been changed.
   - [ ] Other reason 
   
   - Behavior changed:
   
   - [ ] No.
   - [ ] Yes. 
   
   - Does this need documentation?
   
   - [ ] No.
   - [ ] Yes. 
   
   - Release note
   
   
   
   None
   
   ### Check List (For Reviewer who merge this PR)
   
   - [ ] Confirm the release note
   - [ ] Confirm test cases
   - [ ] Confirm document
   - [ ] Add branch pick label 
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[PR] [test](mtmv)add create partition and partition scrolling [doris]

2024-11-07 Thread via GitHub


zfr9527 opened a new pull request, #43455:
URL: https://github.com/apache/doris/pull/43455

   ### What problem does this PR solve?
   
   pick from #42402 
   
   [test](mtmv)add create partition and partition scrolling
   
   
   
   
   Issue Number: close #xxx
   
   
   Related PR: #xxx
   
   Problem Summary:
   
   ### Check List (For Author)
   
   - Test 
   
   - [ ] Regression test
   - [ ] Unit Test
   - [ ] Manual test (add detailed scripts or steps below)
   - [ ] No need to test or manual test. Explain why:
   - [ ] This is a refactor/code format and no logic has been changed.
   - [ ] Previous test can cover this change.
   - [ ] No colde files have been changed.
   - [ ] Other reason 
   
   - Behavior changed:
   
   - [ ] No.
   - [ ] Yes. 
   
   - Does this need documentation?
   
   - [ ] No.
   - [ ] Yes. 
   
   - Release note
   
   
   
   None
   
   ### Check List (For Reviewer who merge this PR)
   
   - [ ] Confirm the release note
   - [ ] Confirm test cases
   - [ ] Confirm document
   - [ ] Add branch pick label 
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [test](mtmv)add create partition and partition scrolling [doris]

2024-10-29 Thread via GitHub


morrySnow merged PR #42402:
URL: https://github.com/apache/doris/pull/42402


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [test](mtmv)add create partition and partition scrolling [doris]

2024-10-29 Thread via GitHub


github-actions[bot] commented on PR #42402:
URL: https://github.com/apache/doris/pull/42402#issuecomment-2443542114

   PR approved by at least one committer and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [test](mtmv)add create partition and partition scrolling [doris]

2024-10-25 Thread via GitHub


zfr9527 commented on PR #42402:
URL: https://github.com/apache/doris/pull/42402#issuecomment-2437330805

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [test](mtmv)add create partition and partition scrolling [doris]

2024-10-25 Thread via GitHub


zfr9527 commented on code in PR #42402:
URL: https://github.com/apache/doris/pull/42402#discussion_r1816350456


##
regression-test/suites/nereids_rules_p0/mv/union_rewrite/partition_curd_union_rewrite_hive.groovy:
##
@@ -0,0 +1,287 @@
+// Licensed to the Apache Software Foundation (ASF) under one
+// or more contributor license agreements.  See the NOTICE file
+// distributed with this work for additional information
+// regarding copyright ownership.  The ASF licenses this file
+// to you under the Apache License, Version 2.0 (the
+// "License"); you may not use this file except in compliance
+// with the License.  You may obtain a copy of the License at
+//
+//   http://www.apache.org/licenses/LICENSE-2.0
+//
+// Unless required by applicable law or agreed to in writing,
+// software distributed under the License is distributed on an
+// "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+// KIND, either express or implied.  See the License for the
+// specific language governing permissions and limitations
+// under the License.
+
+suite ("partition_curd_union_rewrite_hive") {
+String enabled = context.config.otherConfigs.get("enableHiveTest")
+if (enabled == null || !enabled.equalsIgnoreCase("true")) {
+logger.info("diable Hive test.")
+return
+}
+
+sql """SET materialized_view_rewrite_enable_contain_external_table = 
true;"""
+
+def create_mv = { mv_name, mv_sql ->
+sql """DROP MATERIALIZED VIEW IF EXISTS ${mv_name};"""
+sql """DROP TABLE IF EXISTS ${mv_name}"""
+sql"""
+CREATE MATERIALIZED VIEW ${mv_name} 
+BUILD IMMEDIATE REFRESH AUTO ON MANUAL 
+partition by(l_shipdate)
+DISTRIBUTED BY RANDOM BUCKETS 2 
+PROPERTIES ('replication_num' = '1') 
+AS  
+${mv_sql}
+"""
+}
+def compare_res = { def stmt ->
+def mark = true
+sql "SET materialized_view_rewrite_enable_contain_external_table=false"
+def origin_res = sql stmt
+logger.info("origin_res: " + origin_res)
+sql "SET materialized_view_rewrite_enable_contain_external_table=true"
+def mv_origin_res = sql stmt
+logger.info("mv_origin_res: " + mv_origin_res)
+if (!((mv_origin_res == [] && origin_res == []) || 
(mv_origin_res.size() == origin_res.size( {
+mark = false
+return mark
+}
+assertTrue((mv_origin_res == [] && origin_res == []) || 
(mv_origin_res.size() == origin_res.size()))
+for (int row = 0; row < mv_origin_res.size(); row++) {
+if (!(mv_origin_res[row].size() == origin_res[row].size())) {
+mark = false
+return mark
+}
+assertTrue(mv_origin_res[row].size() == origin_res[row].size())
+for (int col = 0; col < mv_origin_res[row].size(); col++) {
+if (!(mv_origin_res[row][col] == origin_res[row][col])) {
+mark = false
+return mark
+}
+assertTrue(mv_origin_res[row][col] == origin_res[row][col])
+}
+}
+return mark
+}
+
+
+String db = context.config.getDbNameByFile(context.file)
+String ctl = "partition_curd_union_hive"
+for (String hivePrefix : ["hive2", "hive3"]) {
+String hms_port = context.config.otherConfigs.get(hivePrefix + 
"HmsPort")
+String hdfs_port = context.config.otherConfigs.get(hivePrefix + 
"HdfsPort")
+String catalog_name = ctl + "_" + hivePrefix
+String externalEnvIp = context.config.otherConfigs.get("externalEnvIp")
+
+sql """drop catalog if exists ${catalog_name}"""
+sql """create catalog if not exists ${catalog_name} properties (
+'type'='hms',
+'hive.metastore.uris' = 
'thrift://${externalEnvIp}:${hms_port}',
+'fs.defaultFS' = 'hdfs://${externalEnvIp}:${hdfs_port}',
+'use_meta_cache' = 'true'
+);"""
+sql """switch ${catalog_name}"""
+sql """create database if not exists ${db}"""
+sql """use `${db}`"""
+String orders_tb_name = catalog_name + "_orders"
+String lineitem_tb_name = catalog_name + "_lineitem"
+def mv_name = catalog_name + "_test_mv"
+
+sql """drop table if exists ${orders_tb_name}"""
+sql """CREATE TABLE IF NOT EXISTS ${orders_tb_name}  (
+  o_orderkey   int,
+  o_custkeyint,
+  o_orderstatusVARCHAR(1),
+  o_totalprice DECIMAL(15, 2),
+  o_orderpriority  VARCHAR(15),  
+  o_clerk  VARCHAR(15), 
+  o_shippriority   int,
+  o_commentVARCHAR(15),
+  o_orderdate  date
+)
+ENGINE=hive
+PARTITION BY LIST (`o_orderdate`) ()
+PROPERTIES ( 
+"replication_num" = 

Re: [PR] [test](mtmv)add create partition and partition scrolling [doris]

2024-10-25 Thread via GitHub


zfr9527 commented on PR #42402:
URL: https://github.com/apache/doris/pull/42402#issuecomment-2434711398

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [test](mtmv)add create partition and partition scrolling [doris]

2024-10-24 Thread via GitHub


seawinde commented on code in PR #42402:
URL: https://github.com/apache/doris/pull/42402#discussion_r181603


##
regression-test/suites/nereids_rules_p0/mv/union_rewrite/partition_curd_union_rewrite_hive.groovy:
##
@@ -0,0 +1,287 @@
+// Licensed to the Apache Software Foundation (ASF) under one
+// or more contributor license agreements.  See the NOTICE file
+// distributed with this work for additional information
+// regarding copyright ownership.  The ASF licenses this file
+// to you under the Apache License, Version 2.0 (the
+// "License"); you may not use this file except in compliance
+// with the License.  You may obtain a copy of the License at
+//
+//   http://www.apache.org/licenses/LICENSE-2.0
+//
+// Unless required by applicable law or agreed to in writing,
+// software distributed under the License is distributed on an
+// "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+// KIND, either express or implied.  See the License for the
+// specific language governing permissions and limitations
+// under the License.
+
+suite ("partition_curd_union_rewrite_hive") {
+String enabled = context.config.otherConfigs.get("enableHiveTest")
+if (enabled == null || !enabled.equalsIgnoreCase("true")) {
+logger.info("diable Hive test.")
+return
+}
+
+sql """SET materialized_view_rewrite_enable_contain_external_table = 
true;"""
+
+def create_mv = { mv_name, mv_sql ->
+sql """DROP MATERIALIZED VIEW IF EXISTS ${mv_name};"""
+sql """DROP TABLE IF EXISTS ${mv_name}"""
+sql"""
+CREATE MATERIALIZED VIEW ${mv_name} 
+BUILD IMMEDIATE REFRESH AUTO ON MANUAL 
+partition by(l_shipdate)
+DISTRIBUTED BY RANDOM BUCKETS 2 
+PROPERTIES ('replication_num' = '1') 
+AS  
+${mv_sql}
+"""
+}
+def compare_res = { def stmt ->
+def mark = true
+sql "SET materialized_view_rewrite_enable_contain_external_table=false"
+def origin_res = sql stmt
+logger.info("origin_res: " + origin_res)
+sql "SET materialized_view_rewrite_enable_contain_external_table=true"
+def mv_origin_res = sql stmt
+logger.info("mv_origin_res: " + mv_origin_res)
+if (!((mv_origin_res == [] && origin_res == []) || 
(mv_origin_res.size() == origin_res.size( {
+mark = false
+return mark
+}
+assertTrue((mv_origin_res == [] && origin_res == []) || 
(mv_origin_res.size() == origin_res.size()))
+for (int row = 0; row < mv_origin_res.size(); row++) {
+if (!(mv_origin_res[row].size() == origin_res[row].size())) {
+mark = false
+return mark
+}
+assertTrue(mv_origin_res[row].size() == origin_res[row].size())
+for (int col = 0; col < mv_origin_res[row].size(); col++) {
+if (!(mv_origin_res[row][col] == origin_res[row][col])) {
+mark = false
+return mark
+}
+assertTrue(mv_origin_res[row][col] == origin_res[row][col])
+}
+}
+return mark
+}
+
+
+String db = context.config.getDbNameByFile(context.file)
+String ctl = "partition_curd_union_hive"
+for (String hivePrefix : ["hive2", "hive3"]) {
+String hms_port = context.config.otherConfigs.get(hivePrefix + 
"HmsPort")
+String hdfs_port = context.config.otherConfigs.get(hivePrefix + 
"HdfsPort")
+String catalog_name = ctl + "_" + hivePrefix
+String externalEnvIp = context.config.otherConfigs.get("externalEnvIp")
+
+sql """drop catalog if exists ${catalog_name}"""
+sql """create catalog if not exists ${catalog_name} properties (
+'type'='hms',
+'hive.metastore.uris' = 
'thrift://${externalEnvIp}:${hms_port}',
+'fs.defaultFS' = 'hdfs://${externalEnvIp}:${hdfs_port}',
+'use_meta_cache' = 'true'
+);"""
+sql """switch ${catalog_name}"""
+sql """create database if not exists ${db}"""
+sql """use `${db}`"""
+String orders_tb_name = catalog_name + "_orders"
+String lineitem_tb_name = catalog_name + "_lineitem"
+def mv_name = catalog_name + "_test_mv"
+
+sql """drop table if exists ${orders_tb_name}"""
+sql """CREATE TABLE IF NOT EXISTS ${orders_tb_name}  (
+  o_orderkey   int,
+  o_custkeyint,
+  o_orderstatusVARCHAR(1),
+  o_totalprice DECIMAL(15, 2),
+  o_orderpriority  VARCHAR(15),  
+  o_clerk  VARCHAR(15), 
+  o_shippriority   int,
+  o_commentVARCHAR(15),
+  o_orderdate  date
+)
+ENGINE=hive
+PARTITION BY LIST (`o_orderdate`) ()
+PROPERTIES ( 
+"replication_num" =

Re: [PR] [test](mtmv)add create partition and partition scrolling [doris]

2024-10-24 Thread via GitHub


github-actions[bot] commented on PR #42402:
URL: https://github.com/apache/doris/pull/42402#issuecomment-2436683933

   PR approved by anyone and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [test](mtmv)add create partition and partition scrolling [doris]

2024-10-24 Thread via GitHub


github-actions[bot] commented on PR #42402:
URL: https://github.com/apache/doris/pull/42402#issuecomment-2436683894

   PR approved by at least one committer and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [test](mtmv)add create partition and partition scrolling [doris]

2024-10-24 Thread via GitHub


zfr9527 closed pull request #40741: [test](mtmv)add create partition and 
partition scrolling
URL: https://github.com/apache/doris/pull/40741


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [test](mtmv)add create partition and partition scrolling [doris]

2024-10-24 Thread via GitHub


zfr9527 commented on PR #40741:
URL: https://github.com/apache/doris/pull/40741#issuecomment-2434713579

   There is a conflict. After resolving it, [a new pull 
request](https://github.com/apache/doris/pull/42402) has been submitted.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[PR] [test](mtmv)add create partition and partition scrolling [doris]

2024-10-24 Thread via GitHub


zfr9527 opened a new pull request, #42402:
URL: https://github.com/apache/doris/pull/42402

   ## Proposed changes
   
   [test](mtmv)add create partition and partition scrolling
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [test](mtmv)add create partition and partition scrolling [doris]

2024-10-24 Thread via GitHub


doris-robot commented on PR #42402:
URL: https://github.com/apache/doris/pull/42402#issuecomment-2434710916

   Thank you for your contribution to Apache Doris.
   Don't know what should be done next? See [How to process your 
PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR)
   
   Since 2024-03-18, the Document has been moved to 
[doris-website](https://github.com/apache/doris-website).
   See [Doris 
Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document).


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [test](mtmv)add create partition and partition scrolling [doris]

2024-10-16 Thread via GitHub


zfr9527 commented on PR #40741:
URL: https://github.com/apache/doris/pull/40741#issuecomment-2415926851

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [test](mtmv)add create partition and partition scrolling [doris]

2024-09-12 Thread via GitHub


zfr9527 commented on PR #40741:
URL: https://github.com/apache/doris/pull/40741#issuecomment-2345653252

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



Re: [PR] [test](mtmv)add create partition and partition scrolling [doris]

2024-09-12 Thread via GitHub


doris-robot commented on PR #40741:
URL: https://github.com/apache/doris/pull/40741#issuecomment-2345645612

   Thank you for your contribution to Apache Doris.
   Don't know what should be done next? See [How to process your 
PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR)
   
   Since 2024-03-18, the Document has been moved to 
[doris-website](https://github.com/apache/doris-website).
   See [Doris 
Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document).


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[PR] [test](mtmv)add create partition and partition scrolling [doris]

2024-09-12 Thread via GitHub


zfr9527 opened a new pull request, #40741:
URL: https://github.com/apache/doris/pull/40741

   ## Proposed changes
   
   [test](mtmv)add create partition and partition scrolling
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org