This is an automated email from the ASF dual-hosted git repository.
morrysnow pushed a change to branch runtimefilter_multi_send
in repository https://gitbox.apache.org/repos/asf/doris.git
discard 6582adbec5 [fix] conjuncts not initialized (#21376)
omit dae170394f [opt](Nereids) support set cte shuffle type for each
consumer
omit 45c7f137db [feature](runtime_filter) MultiCastSender supporting
runtime filter on be (#21304)
add df23ab3f29 [Enhancement](tvf) Add authentication for workload group
tvf (#21323)
add 8f4b7c8f3d [Fix](multi-catalog) optimize hashcode for PartitionKey.
(#21307)
add 8809cca74a [fix](nereids) physical sort node's equals method should
compare sort phase (#21301)
add d76fa427a3 [improve](jsonb)Invalid json path prompts an error instead
of null (#19646)
add 1ac724c2dd [enhance](BufferedReader) don't blocking wait on buffered
reader's condition variable (#21153)
add 25b5bab22d [fix](memory) Fix hash table buf initialize null pointer
(#21315)
add 53f90cb2e3 [fix](load) fix tablet id in RowsetWriterContext (#21336)
add 2c3183f5eb [Feature](Job)Provide unified internal Job scheduling
(#21113)
add de39632f1b [feature](binlog) Add AddPartitionRecord && DROP_PARTITION
(#21344)
add b7d6a70868 [FIX](datatype) Implement hash func with array/map/struct
type (#21334)
add 88cbea2b56 [Bug](agg-state) fix core dump on not nullable argument for
aggstate's nested argument (#21331)
add 164448dac3 [fix](nereids) fix rf info missing for set op (#21367)
add 4117f0b93b [improve](nereids) Support outer rf into inner left outer
join (#21368)
add 18b7d84436 [fix](Nereids): reject infer distinct when children exist
NLJ (#21391)
add ed2cd4974e [fix](nereids) to_date should return type datev2 for
datetimev2 (#21375)
add 96aa0e5876 [fix](tvf) To fix the bug that requires adding backticks on
"frontends()" in order to query the frontends TVF. (#21338)
new 2a158caf5d [feature](runtime_filter) MultiCastSender supporting
runtime filter on be (#21304)
new 90a89f8f56 [opt](Nereids) support set cte shuffle type for each
consumer
new 2953f99a70 [fix] conjuncts not initialized (#21376)
new 2dc87c65ba [opt](Nereids) optimize explain stream of DataStreamSink
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (6582adbec5)
\
N -- N -- N refs/heads/runtimefilter_multi_send (2dc87c65ba)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
The 4 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
be/src/io/fs/buffered_reader.cpp | 46 +-
be/src/olap/delta_writer.cpp | 2 +-
be/src/util/jsonb_document.h | 247 ++-
be/src/util/jsonb_error.h | 2 +
be/src/vec/columns/column.h | 16 +-
be/src/vec/columns/column_array.cpp | 63 +
be/src/vec/columns/column_array.h | 14 +
be/src/vec/columns/column_const.h | 14 +
be/src/vec/columns/column_decimal.cpp | 31 +-
be/src/vec/columns/column_decimal.h | 3 +
be/src/vec/columns/column_map.cpp | 68 +-
be/src/vec/columns/column_map.h | 13 +
be/src/vec/columns/column_nullable.cpp | 18 +
be/src/vec/columns/column_nullable.h | 9 +-
be/src/vec/columns/column_string.h | 12 +
be/src/vec/columns/column_struct.cpp | 31 +
be/src/vec/columns/column_struct.h | 13 +
be/src/vec/columns/column_vector.h | 18 +
be/src/vec/common/hash_table/hash_table.h | 4 +-
be/src/vec/exec/scan/vmeta_scan_node.cpp | 9 +-
be/src/vec/exec/scan/vmeta_scan_node.h | 2 +
be/src/vec/exec/scan/vmeta_scanner.cpp | 5 +-
be/src/vec/exec/scan/vmeta_scanner.h | 5 +-
be/src/vec/exprs/vectorized_agg_fn.cpp | 21 +-
.../array/function_array_enumerate_uniq.cpp | 14 +
be/src/vec/functions/function_jsonb.cpp | 68 +-
be/src/vec/sink/vdata_stream_sender.cpp | 15 +-
be/test/vec/columns/column_hash_func_test.cpp | 190 ++
be/test/vec/function/function_jsonb_test.cpp | 83 +-
.../table-functions/workload-group.md | 2 +-
.../table-functions/workload-group.md | 2 +-
fe/fe-core/src/main/cup/sql_parser.cup | 2 +
.../org/apache/doris/analysis/ArithmeticExpr.java | 2 +-
.../org/apache/doris/analysis/DateLiteral.java | 6 +-
.../apache/doris/analysis/NativeInsertStmt.java | 22 +-
.../apache/doris/binlog/AddPartitionRecord.java | 23 +
.../org/apache/doris/binlog/BinlogManager.java | 12 +
.../doris/catalog/MaterializedIndexMeta.java | 3 -
.../org/apache/doris/catalog/PartitionKey.java | 6 +-
.../glue/translator/PhysicalPlanTranslator.java | 8 +-
.../glue/translator/PlanTranslatorContext.java | 6 +-
.../processor/post/RuntimeFilterGenerator.java | 59 +-
.../rules/rewrite/InferSetOperatorDistinct.java | 19 +
.../functions/AggStateFunctionBuilder.java | 13 +-
.../functions/combinator/MergeCombinator.java | 6 +-
.../functions/combinator/StateCombinator.java | 2 +-
.../functions/combinator/UnionCombinator.java | 6 +-
.../executable/DateTimeExtractAndTransform.java | 4 +-
.../trees/plans/physical/AbstractPhysicalSort.java | 2 +-
.../apache/doris/nereids/types/AggStateType.java | 11 +-
.../apache/doris/persist/DropPartitionInfo.java | 13 +
.../java/org/apache/doris/persist/EditLog.java | 12 +-
.../org/apache/doris/planner/DataStreamSink.java | 5 +-
.../doris/planner/external/MetadataScanNode.java | 4 +
.../resource/workloadgroup/WorkloadGroupMgr.java | 21 +-
.../apache/doris/scheduler/AsyncJobRegister.java | 82 +
.../apache/doris/scheduler/JobRegisterFactory.java | 31 +-
.../doris/scheduler/constants/JobStatus.java | 28 +-
.../doris/scheduler/constants/SystemJob.java | 32 +-
.../scheduler/disruptor/TimerTaskDisruptor.java | 133 ++
.../doris/scheduler/disruptor/TimerTaskEvent.java | 28 +-
.../disruptor/TimerTaskExpirationHandler.java | 125 ++
.../doris/scheduler/executor/JobExecutor.java | 27 +-
.../doris/scheduler/job/AsyncJobManager.java | 262 +++
.../apache/doris/scheduler/job/DorisTimerTask.java | 58 +
.../java/org/apache/doris/scheduler/job/Job.java | 148 ++
.../doris/scheduler/registry/JobRegister.java | 111 ++
.../FrontendsTableValuedFunction.java | 4 +-
.../doris/tablefunction/MetadataGenerator.java | 8 +-
.../java/org/apache/doris/analysis/ExprTest.java | 2 +-
.../org/apache/doris/analysis/LoadStmtTest.java | 4 +-
.../apache/doris/analysis/S3TvfLoadStmtTest.java | 2 +-
.../org/apache/doris/catalog/PartitionKeyTest.java | 17 +
.../nereids/postprocess/RuntimeFilterTest.java | 8 +-
.../org/apache/doris/planner/RepeatNodeTest.java | 4 +-
.../scheduler/disruptor/AsyncJobManagerTest.java | 117 ++
.../disruptor/TimerTaskDisruptorTest.java | 77 +
fe/pom.xml | 8 +-
gensrc/thrift/FrontendService.thrift | 3 +
gensrc/thrift/PlanNodes.thrift | 1 +
.../agg_state/max/test_agg_state_max.out | 33 +
.../hive/test_hive_to_date.out | 25 +
.../data/json_p0/test_json_load_and_function.out | 50 +-
.../test_json_load_unique_key_and_function.out | 50 +-
.../data/jsonb_p0/test_jsonb_load_and_function.out | 1940 ++++++++++++++++++--
.../test_jsonb_load_unique_key_and_function.out | 1940 ++++++++++++++++++--
regression-test/data/mv_p0/k1ap2spa/k1ap2spa.out | 2 +
.../nereids_tpcds_shape_sf100_p0/shape/query21.out | 34 +-
.../test_frontends_tvf.groovy | 22 +
.../agg_state/max/test_agg_state_max.groovy | 27 +-
.../hive/test_hive_to_date.groovy | 49 +
.../jsonb_p0/test_jsonb_load_and_function.groovy | 90 +-
.../test_jsonb_load_unique_key_and_function.groovy | 90 +-
.../suites/mv_p0/k1ap2spa/k1ap2spa.groovy | 1 +
94 files changed, 6188 insertions(+), 792 deletions(-)
create mode 100644 be/test/vec/columns/column_hash_func_test.cpp
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/scheduler/AsyncJobRegister.java
copy
regression-test/suites/correctness_p0/table_valued_function/test_frontends_tvf.groovy
=> fe/fe-core/src/main/java/org/apache/doris/scheduler/JobRegisterFactory.java
(50%)
copy
regression-test/suites/correctness_p0/table_valued_function/test_frontends_tvf.groovy
=>
fe/fe-core/src/main/java/org/apache/doris/scheduler/constants/JobStatus.java
(59%)
copy
regression-test/suites/correctness_p0/table_valued_function/test_frontends_tvf.groovy
=>
fe/fe-core/src/main/java/org/apache/doris/scheduler/constants/SystemJob.java
(60%)
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/scheduler/disruptor/TimerTaskDisruptor.java
copy
regression-test/suites/correctness_p0/table_valued_function/test_frontends_tvf.groovy
=>
fe/fe-core/src/main/java/org/apache/doris/scheduler/disruptor/TimerTaskEvent.java
(55%)
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/scheduler/disruptor/TimerTaskExpirationHandler.java
copy
regression-test/suites/correctness_p0/table_valued_function/test_frontends_tvf.groovy
=>
fe/fe-core/src/main/java/org/apache/doris/scheduler/executor/JobExecutor.java
(58%)
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/scheduler/job/AsyncJobManager.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/scheduler/job/DorisTimerTask.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/scheduler/job/Job.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/scheduler/registry/JobRegister.java
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/scheduler/disruptor/AsyncJobManagerTest.java
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/scheduler/disruptor/TimerTaskDisruptorTest.java
create mode 100644
regression-test/data/external_table_emr_p2/hive/test_hive_to_date.out
create mode 100644
regression-test/suites/external_table_emr_p2/hive/test_hive_to_date.groovy
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]