This is an automated email from the ASF dual-hosted git repository. lichaoyong pushed a change to branch branch-0.12 in repository https://gitbox.apache.org/repos/asf/incubator-doris.git.
omit 5e08725 Revert "Remove deep copy when doing hash table EvalRow (#3171)" (#3173) add dff3c0d Revert "Remove deep copy when doing hash table EvalRow (#3171)" (#3173) add d4c1938 Open datetime min value limit (#3158) add 3b32938 [Doc] Create CONTRIBUTING.md (#3180) add e20d905 Remove unused KUDU codes (#3175) add e794bb6 [BUG] Make default result ordering of SHOW PARTITIONS statement be consist with 0.11 (#3184) add 3cff89d [Dynamic Partition] Support for automatically drop partitions (#3081) add b2518fc [SQL] Support non-correlated subquery in having clause (#3150) add 71bc815 [SQL] Support subquery in case when statement (#3135) add dfd1a33 [Dynamic Partition] Unify dynamic partition name and range (#3193) add 8aa8b8c [Code Refactor] Using block manager to unify the data file access. (#3189) add c0282bb Solve the problem of mv selector when there is having clause in query (#3176) add 8fa328c [Doc]Update doc for dynamic partition (#3093) add 8426669 [Plugin] Add BE plugin framework (#2348) (#2618) add f585f30 [Plugin] Add FE plugin framework (#2463) add a07fedd Fix unix_timestamp core where time less 1970 (#3198) add eda23b5 [Plugin] Create the FE plugin dir if missing (#3202) add cc31bf9 [rowset id] A little improvement of rowset id generator (#3203) add c4c37a4 Rewritten subquery in having clause (#3206) add 16b61b6 [Spark] Support convert Arrow data to RowBatch asynchronously in Spark-Doris-Connector (#3186) add 0462607 StorageEngine: unused_rowsets use unordered_multimap (#3207) add 32c4fc6 Support determine isPreviousLoadFinished for some alter jobs in table level (#3196) add c1969a3 [Conf] Make default_storage_medium configurable (#2980) add aa8b2f8 [Bug][Refactor] Fix the conflict of temp partition and dynamic partition operations (#3201) add cb68e10 [MaterializedView] Add 'IndexKeysType' field in 'Desc all table stmt' (#3209) add d3555e3 [Conf][API Change] Change the default FE meta dir and BE storage_root_path add 4a5164a Fix 'Filesystem closed' in broker load (#3216) add 6cf217f Fix WARNING to WARN in fe.conf sys_log_level (#3218) add 41f1ab0 Add curdate/now function in fe (#3215) add e468239 [web] Dump configs on BE's website '/varz' (#3220) add 5f9359d Use SleepFor() instead of usleep() (#3211) add 2e1a003 Add some connect samples (#3221) add 4131afe [Bug] NPE when using unknown function in broker load process (#3225) add e9b3584 [Bug] Fix bug that `desc tbl all` stmt throw error: Malformed packet (#3233) add 0554e89 [Alter] Fix bug of assertion failure when submitting schema change job (#3181) add 68a801f Support Java version 64 bits Integers for BITMAP type (#3090) add 028da65 Increased compatibility with mysql (#3235) add 8a2eb8f [Bug][segment_v2] Fix a bug that NullBitmapBuilder is not reset when data page doesn't have null (#3240) add 6a9a629 Fix bug of memory limit when group by varchar columns. (#3242) add 34993a6 Fix colocate relocateGroup bug after decommission (#3239) add 63cee94 Fix output results may incorrect when using intersect and except statements (#3228) add 9c93718 [Alter]Clean SchemaChangeJobV2 when schema change CANCELLED or FINISHED (#3212) add 29b37da Sql reference of materialized view (#3208) add 6252a27 Rewrite count distinct bitmap and hll in order by and having (#3232) add 390f462 [Bug] Fix read schema change job meta bug (#3244) add d14726e Fix join hints not work when need table reorder (#3188) add c9ff6f6 Fix Rewrite count distinct bitmap and hll order by bug (#3251) add fcb6513 [Plugin] Making FE audit module pluggable (#3219) new d465a8c Fix spell error (#3255) This update added new revisions after undoing existing revisions. That is to say, some revisions that were in the old version of the branch are not in the new version. This situation occurs when a user --force pushes a change and generates a repository containing something like this: * -- * -- B -- O -- O -- O (5e08725) \ N -- N -- N refs/heads/branch-0.12 (d465a8c) You should already have received notification emails for all of the O revisions, and so the following emails describe only the N revisions from the common base, B. Any revisions marked "omit" are not gone; other references still refer to them. Any revisions marked "discard" are gone forever. The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: .gitignore | 3 + CONTRIBUTING.md | 1 + CONTRIBUTING_CN.md | 1 + be/CMakeLists.txt | 22 + be/src/agent/task_worker_pool.cpp | 373 +++-- be/src/common/config.h | 27 +- be/src/common/configbase.cpp | 110 +- be/src/common/configbase.h | 74 +- be/src/exec/CMakeLists.txt | 9 +- be/src/exec/broker_reader.cpp | 56 +- be/src/exec/es/es_scroll_parser.cpp | 4 - be/src/exec/except_node.cpp | 107 +- be/src/exec/except_node.h | 34 +- be/src/exec/intersect_node.cpp | 79 +- be/src/exec/intersect_node.h | 30 +- be/src/exec/kudu_scan_node.cpp | 344 ----- be/src/exec/kudu_scan_node.h | 154 --- be/src/exec/kudu_scanner.cpp | 228 --- be/src/exec/kudu_scanner.h | 106 -- be/src/exec/kudu_util.cpp | 107 -- be/src/exec/kudu_util.h | 71 - be/src/exec/partitioned_aggregation_node_ir.cc | 2 + be/src/exec/partitioned_hash_table.h | 1 + be/src/exec/set_operation_node.cpp | 136 ++ .../{intersect_node.h => set_operation_node.h} | 33 +- be/src/exec/tablet_sink.cpp | 21 - be/src/exec/text_converter.hpp | 10 - be/src/exprs/utility_functions.cpp | 17 +- be/src/exprs/utility_functions.h | 12 +- be/src/gutil/CMakeLists.txt | 3 - be/src/http/default_path_handlers.cpp | 35 +- be/src/http/web_page_handler.cpp | 86 +- be/src/olap/data_dir.cpp | 355 ++--- be/src/olap/fs/block_id.cpp | 2 +- be/src/olap/fs/file_block_manager.cpp | 45 +- be/src/olap/fs/file_block_manager.h | 4 + be/src/olap/fs/fs_util.cpp | 12 +- be/src/olap/fs/fs_util.h | 2 +- be/src/olap/olap_common.h | 11 +- be/src/olap/out_stream.cpp | 76 +- be/src/olap/rowset/beta_rowset_writer.cpp | 5 +- be/src/olap/rowset/column_writer.cpp | 2 +- be/src/olap/rowset/rowset.h | 2 + be/src/olap/rowset/rowset_id_generator.h | 2 +- .../olap/rowset/segment_v2/bitmap_index_reader.h | 1 - .../rowset/segment_v2/bloom_filter_index_reader.h | 3 +- be/src/olap/rowset/segment_v2/column_reader.cpp | 3 +- be/src/olap/rowset/segment_v2/column_reader.h | 9 +- be/src/olap/rowset/segment_v2/column_writer.cpp | 4 +- .../rowset/segment_v2/indexed_column_reader.cpp | 24 +- .../olap/rowset/segment_v2/indexed_column_reader.h | 22 +- .../olap/rowset/segment_v2/ordinal_page_index.cpp | 10 +- be/src/olap/rowset/segment_v2/page_io.cpp | 4 +- be/src/olap/rowset/segment_v2/page_io.h | 9 +- be/src/olap/rowset/segment_v2/segment.cpp | 24 +- be/src/olap/rowset/segment_v2/segment.h | 1 - be/src/olap/rowset/segment_v2/segment_iterator.cpp | 8 +- be/src/olap/rowset/segment_v2/segment_iterator.h | 8 +- be/src/olap/rowset/unique_rowset_id_generator.cpp | 16 +- be/src/olap/rowset/unique_rowset_id_generator.h | 14 +- be/src/olap/storage_engine.cpp | 44 +- be/src/olap/storage_engine.h | 1 + be/src/olap/tablet_manager.cpp | 2 + be/{test/common => src/plugin}/CMakeLists.txt | 12 +- be/src/plugin/plugin.h | 41 +- be/src/plugin/plugin_loader.cpp | 194 +++ be/src/plugin/plugin_loader.h | 117 ++ be/src/plugin/plugin_mgr.cpp | 162 +++ be/src/plugin/plugin_mgr.h | 69 + be/src/plugin/plugin_zip.cpp | 131 ++ be/src/plugin/{plugin_manager.h => plugin_zip.h} | 26 +- be/src/runtime/datetime_value.cpp | 4 + be/src/runtime/descriptors.cpp | 17 - be/src/runtime/descriptors.h | 18 - be/src/runtime/exec_env.h | 5 + be/src/runtime/exec_env_init.cpp | 2 + be/src/service/doris_main.cpp | 66 +- be/src/util/CMakeLists.txt | 1 - be/src/util/file_manager.cpp | 38 - be/src/util/file_manager.h | 54 - be/src/util/runtime_profile.cpp | 280 ++-- be/src/util/thread.h | 4 +- be/src/util/thrift_client.cpp | 3 +- be/src/util/thrift_util.cpp | 60 +- be/test/common/CMakeLists.txt | 1 + be/test/common/config_test.cpp | 74 + be/test/olap/column_reader_test.cpp | 63 + .../segment_v2/column_reader_writer_test.cpp | 24 +- .../rowset/unique_rowset_id_generator_test.cpp | 109 +- be/test/{common => plugin}/CMakeLists.txt | 10 +- be/test/{common => plugin/example}/CMakeLists.txt | 8 +- .../plugin/example/plugin_example.cpp} | 38 +- be/test/plugin/plugin_loader_test.cpp | 123 ++ be/test/plugin/plugin_mgr_test.cpp | 105 ++ be/test/plugin/plugin_test/source/test.zip | Bin 0 -> 2542556 bytes be/test/plugin/plugin_test/source/test.zip.md5 | 1 + be/test/plugin/plugin_zip_test.cpp | 164 +++ be/test/runtime/buffered_block_mgr2_test.cpp | 325 +++-- be/test/runtime/data_stream_test.cpp | 212 ++- be/test/runtime/datetime_value_test.cpp | 4 + be/test/runtime/fragment_mgr_test.cpp | 39 +- be/test/runtime/stream_load_pipe_test.cpp | 15 +- be/test/util/CMakeLists.txt | 1 - be/test/util/file_manager_test.cpp | 67 - be/test/util/thread_test.cpp | 32 +- build_plugin.sh | 126 ++ conf/be.conf | 13 +- conf/fe.conf | 7 +- .../alter-table/alter-table-schema-change.md | 10 +- .../cn/administrator-guide/dynamic-partition.md | 66 +- .../materialized-view/index.rst | 9 + .../cn/community/how-to-contribute.md | 1 + .../cn/extending-doris/audit-plugin.md | 108 ++ .../extending-doris/plugin-development-manual.md | 291 ++++ .../cn/getting-started/data-partition.md | 2 +- docs/documentation/cn/installing/install-deploy.md | 6 +- .../DATE.md => Administration/INSTALL PLUGIN.md} | 37 +- .../DATETIME.md => Administration/SHOW PLUGINS.md} | 22 +- .../DATE.md => Administration/UNINSTALL PLUGIN.md} | 27 +- .../Data Definition/CREATE MATERIALIZED VIEW.md | 230 +++ .../sql-statements/Data Definition/CREATE TABLE.md | 17 +- .../Data Definition/DROP MATERIALIZED VIEW.md | 101 ++ .../sql-statements/Data Types/DATE.md | 2 +- .../sql-statements/Data Types/DATETIME.md | 2 +- .../en/community/how-to-contribute_EN.md | 2 + .../en/extending-doris/audit-plugin_EN.md | 89 ++ .../plugin-development-manual_EN.md | 293 ++++ .../en/getting-started/data-partition_EN.md | 2 +- .../en/installing/install-deploy_EN.md | 6 +- .../Administration/INSTALL PLUGIN_EN.md} | 37 +- .../Administration/SHOW PLUGINS_EN.md} | 22 +- .../Administration/UNINTALL PLUGIN_EN.md} | 27 +- .../Data Definition/CREATE MATERIALIZED VIEW.md | 231 ++++ .../Data Definition/CREATE TABLE_EN.md | 6 +- .../Data Definition/DROP MATERIALIZED VIEW.md | 103 ++ .../sql-statements/Data Types/DATETIME_EN.md | 2 +- .../sql-statements/Data Types/DATE_EN.md | 2 +- extension/spark-doris-connector/README.md | 2 + .../doris/spark/cfg/ConfigurationOptions.java | 6 + .../apache/doris/spark/serialization/RowBatch.java | 67 +- .../org/apache/doris/spark/util/ErrorMessages.java | 1 + .../apache/doris/spark/rdd/ScalaValueReader.scala | 106 +- .../src/main/thrift/doris/Status.thrift | 4 +- .../src/main/thrift/doris/Types.thrift | 2 +- fe/pom.xml | 28 +- fe/src/main/cup/sql_parser.cup | 26 +- fe/src/main/java/org/apache/doris/alter/Alter.java | 224 +-- .../main/java/org/apache/doris/alter/AlterJob.java | 3 +- .../java/org/apache/doris/alter/AlterJobV2.java | 2 +- .../java/org/apache/doris/alter/AlterOpType.java | 62 + .../org/apache/doris/alter/AlterOperations.java | 103 ++ .../doris/alter/MaterializedViewHandler.java | 2 +- .../java/org/apache/doris/alter/RollupJobV2.java | 26 +- .../apache/doris/alter/SchemaChangeHandler.java | 96 +- .../org/apache/doris/alter/SchemaChangeJobV2.java | 171 ++- .../org/apache/doris/analysis/AddColumnClause.java | 2 + .../apache/doris/analysis/AddColumnsClause.java | 2 + .../apache/doris/analysis/AddPartitionClause.java | 4 +- .../org/apache/doris/analysis/AddRollupClause.java | 9 +- .../org/apache/doris/analysis/AlterClause.java | 12 + .../apache/doris/analysis/AlterClusterClause.java | 2 + .../doris/analysis/AlterLoadErrorUrlClause.java | 2 + .../apache/doris/analysis/AlterTableClause.java | 7 + .../org/apache/doris/analysis/AlterUserClause.java | 11 +- .../java/org/apache/doris/analysis/Analyzer.java | 44 +- .../org/apache/doris/analysis/ArithmeticExpr.java | 43 +- .../org/apache/doris/analysis/BackendClause.java | 3 + .../org/apache/doris/analysis/BinaryPredicate.java | 42 +- .../apache/doris/analysis/ColumnRenameClause.java | 2 + .../apache/doris/analysis/CreateIndexClause.java | 3 +- .../doris/analysis/CreateMaterializedViewStmt.java | 2 +- .../org/apache/doris/analysis/CreateTableStmt.java | 85 +- .../org/apache/doris/analysis/DateLiteral.java | 4 +- .../org/apache/doris/analysis/DescribeStmt.java | 7 +- .../apache/doris/analysis/DropColumnClause.java | 2 + .../org/apache/doris/analysis/DropIndexClause.java | 3 +- .../apache/doris/analysis/DropPartitionClause.java | 2 + .../apache/doris/analysis/DropRollupClause.java | 2 + .../java/org/apache/doris/analysis/ExportStmt.java | 1 - .../main/java/org/apache/doris/analysis/Expr.java | 12 + .../java/org/apache/doris/analysis/FromClause.java | 4 +- .../org/apache/doris/analysis/FrontendClause.java | 2 + .../apache/doris/analysis/FunctionCallExpr.java | 5 +- .../java/org/apache/doris/analysis/IndexDef.java | 8 +- .../org/apache/doris/analysis/InlineViewRef.java | 6 +- .../java/org/apache/doris/analysis/InsertStmt.java | 9 +- ...{FrontendClause.java => InstallPluginStmt.java} | 59 +- .../apache/doris/analysis/ModifyBrokerClause.java | 3 + .../apache/doris/analysis/ModifyColumnClause.java | 2 + .../doris/analysis/ModifyPartitionClause.java | 4 +- .../analysis/ModifyTablePropertiesClause.java | 3 + .../org/apache/doris/analysis/OrderByElement.java | 6 + .../doris/analysis/PartitionRenameClause.java | 2 + .../java/org/apache/doris/analysis/QueryStmt.java | 58 + .../doris/analysis/ReorderColumnsClause.java | 2 + .../doris/analysis/ReplacePartitionClause.java | 2 + .../apache/doris/analysis/RollupRenameClause.java | 2 + .../java/org/apache/doris/analysis/SelectList.java | 13 +- .../java/org/apache/doris/analysis/SelectStmt.java | 266 ++-- .../org/apache/doris/analysis/SetNamesVar.java | 4 + .../apache/doris/analysis/SetOperationStmt.java | 11 +- .../doris/analysis/ShowDynamicPartitionStmt.java | 4 +- .../org/apache/doris/analysis/ShowPluginsStmt.java | 12 +- .../doris/analysis/SingleRangePartitionDesc.java | 4 +- .../org/apache/doris/analysis/StmtRewriter.java | 257 +++- .../java/org/apache/doris/analysis/TableRef.java | 19 + .../apache/doris/analysis/TableRenameClause.java | 2 + .../org/apache/doris/analysis/TupleDescriptor.java | 28 + ...rontendClause.java => UninstallPluginStmt.java} | 58 +- .../java/org/apache/doris/catalog/BrokerTable.java | 4 +- .../java/org/apache/doris/catalog/Catalog.java | 203 ++- .../org/apache/doris/catalog/DataProperty.java | 4 +- .../doris/catalog/DynamicPartitionProperty.java | 9 + .../org/apache/doris/catalog/KuduPartition.java | 131 -- .../java/org/apache/doris/catalog/KuduTable.java | 142 -- .../java/org/apache/doris/catalog/OlapTable.java | 4 - .../java/org/apache/doris/catalog/Partition.java | 2 +- .../org/apache/doris/catalog/PartitionInfo.java | 11 +- .../org/apache/doris/catalog/PartitionKey.java | 8 +- .../main/java/org/apache/doris/catalog/Table.java | 3 - .../org/apache/doris/catalog/TableProperty.java | 4 +- .../apache/doris/clone/ColocateTableBalancer.java | 4 +- .../doris/clone/DynamicPartitionScheduler.java | 250 ++-- .../org/apache/doris/clone/TabletScheduler.java | 2 +- .../main/java/org/apache/doris/common/Config.java | 26 +- .../java/org/apache/doris/common/ErrorCode.java | 12 +- .../org/apache/doris/common/FeMetaVersion.java | 9 +- .../java/org/apache/doris/common/io/Writable.java | 2 +- .../doris/common/proc/PartitionsProcDir.java | 30 +- .../apache/doris/common/util/DigitalVersion.java | 134 ++ .../doris/common/util/DynamicPartitionUtil.java | 64 +- .../org/apache/doris/common/util/KuduUtil.java | 377 ----- .../apache/doris/common/util/PropertyAnalyzer.java | 27 - .../org/apache/doris/common/util/TimeUtils.java | 4 +- .../java/org/apache/doris/common/util/Util.java | 34 + .../java/org/apache/doris/external/EsUtil.java | 7 - .../doris/http/rest/TableQueryPlanAction.java | 2 +- .../doris/http/rest/TableRowCountAction.java | 2 +- .../apache/doris/http/rest/TableSchemaAction.java | 2 +- .../org/apache/doris/journal/JournalEntity.java | 11 + .../apache/doris/journal/bdbje/BDBJEJournal.java | 3 +- .../main/java/org/apache/doris/kudu/KuduAgent.java | 101 -- fe/src/main/java/org/apache/doris/load/Load.java | 3 +- .../main/java/org/apache/doris/load/LoadJob.java | 6 + .../org/apache/doris/load/loadv2/BitmapValue.java | 330 +++++ .../apache/doris/load/loadv2/BrokerLoadJob.java | 3 +- .../java/org/apache/doris/load/loadv2/LoadJob.java | 1 - .../org/apache/doris/load/loadv2/LoadManager.java | 4 +- .../doris/load/loadv2/LoadingTaskPlanner.java | 12 +- .../org/apache/doris/load/loadv2/MiniLoadJob.java | 8 +- .../org/apache/doris/load/loadv2/Roaring64Map.java | 1462 ++++++++++++++++++++ .../load/routineload/RoutineLoadTaskInfo.java | 3 +- .../java/org/apache/doris/persist/EditLog.java | 19 + .../org/apache/doris/persist/OperationType.java | 5 + .../org/apache/doris/planner/BrokerScanNode.java | 6 +- .../org/apache/doris/planner/CrossJoinNode.java | 20 +- .../doris/planner/MaterializedViewSelector.java | 12 +- .../java/org/apache/doris/plugin/AuditEvent.java | 169 +++ .../plugin/{PluginType.java => AuditPlugin.java} | 17 +- ...PluginManager.java => BuiltinPluginLoader.java} | 39 +- .../apache/doris/plugin/DynamicPluginLoader.java | 233 ++++ .../doris/plugin/ExtendedPluginsClassLoader.java | 57 + .../main/java/org/apache/doris/plugin/Plugin.java | 33 +- .../{PluginType.java => PluginClassLoader.java} | 12 +- .../org/apache/doris/plugin/PluginContext.java | 29 +- .../{PluginType.java => PluginException.java} | 16 +- .../java/org/apache/doris/plugin/PluginInfo.java | 237 ++++ .../java/org/apache/doris/plugin/PluginLoader.java | 118 ++ .../java/org/apache/doris/plugin/PluginMgr.java | 259 ++++ .../java/org/apache/doris/plugin/PluginZip.java | 193 +++ .../java/org/apache/doris/qe/AuditBuilder.java | 41 - .../org/apache/doris/qe/AuditEventProcessor.java | 117 ++ .../java/org/apache/doris/qe/AuditLogBuilder.java | 92 ++ .../java/org/apache/doris/qe/ConnectContext.java | 9 +- .../java/org/apache/doris/qe/ConnectProcessor.java | 50 +- .../main/java/org/apache/doris/qe/DdlExecutor.java | 7 + .../java/org/apache/doris/qe/SessionVariable.java | 11 + .../java/org/apache/doris/qe/ShowExecutor.java | 47 +- .../java/org/apache/doris/qe/StmtExecutor.java | 4 +- .../java/org/apache/doris/rewrite/FEFunctions.java | 12 + .../apache/doris/service/FrontendServiceImpl.java | 28 +- .../org/apache/doris/task/LoadPendingTask.java | 4 +- .../java/org/apache/doris/task/PullLoadJobMgr.java | 2 +- .../doris/transaction/GlobalTransactionMgr.java | 51 +- .../apache/doris/transaction/TransactionState.java | 27 +- fe/src/main/jflex/sql_scanner.flex | 2 + .../org/apache/doris/alter/AlterJobV2Test.java | 130 ++ .../java/org/apache/doris/alter/AlterTest.java | 190 +++ .../apache/doris/analysis/BinaryPredicateTest.java | 16 +- .../apache/doris/analysis/DescribeStmtTest.java | 7 +- .../doris/analysis/LiteralExprCompareTest.java | 4 +- .../org/apache/doris/analysis/SelectStmtTest.java | 65 +- .../apache/doris/analysis/StmtRewriterTest.java | 615 ++++++++ .../org/apache/doris/catalog/CatalogTestUtil.java | 2 +- .../doris/catalog/DynamicPartitionTableTest.java | 41 +- .../org/apache/doris/catalog/PartitionKeyTest.java | 2 +- .../apache/doris/catalog/TablePropertyTest.java | 2 + .../apache/doris/catalog/TempPartitionTest.java | 2 +- .../apache/doris/common/util/TimeUtilsTest.java | 6 +- .../org/apache/doris/common/util/UnitTestUtil.java | 2 +- .../org/apache/doris/common/util/VersionTest.java | 76 + .../org/apache/doris/http/DorisHttpTestCase.java | 4 +- .../apache/doris/load/loadv2/BitmapValueTest.java | 465 +++++++ .../org/apache/doris/load/loadv2/LoadJobTest.java | 3 +- .../persist/ModifyDynamicPartitionInfoTest.java | 1 + .../apache/doris/planner/ConstantExpressTest.java | 8 + .../doris/planner/HashDistributionPrunerTest.java | 2 +- .../planner/MaterializedViewFunctionTest.java | 46 +- .../planner/MaterializedViewSelectorTest.java | 32 - .../org/apache/doris/planner/QueryPlanTest.java | 72 + .../org/apache/doris/plugin/PluginInfoTest.java | 89 ++ .../org/apache/doris/plugin/PluginLoaderTest.java | 94 ++ .../org/apache/doris/plugin/PluginMgrTest.java | 169 +++ .../org/apache/doris/plugin/PluginTestUtil.java} | 39 +- .../org/apache/doris/plugin/PluginZipTest.java | 170 +++ .../apache/doris/qe/AuditEventProcessorTest.java | 124 ++ .../org/apache/doris/qe/ConnectProcessorTest.java | 10 +- .../transaction/GlobalTransactionMgrTest.java | 24 +- .../java/org/apache/doris/utframe/DemoTest.java | 4 +- .../java/org/apache/doris/utframe/DorisAssert.java | 2 +- .../org/apache/doris/utframe/UtFrameUtils.java | 2 + .../java/plugin/PluginTest.java} | 52 +- fe/src/test/resources/plugin_test/auditdemo.zip | Bin 0 -> 2573 bytes fe/src/test/resources/plugin_test/plugin_test.jar | Bin 0 -> 1258 bytes .../resources/plugin_test/source/plugin.properties | 26 + fe/src/test/resources/plugin_test/source/test.zip | Bin 0 -> 180 bytes .../test/resources/plugin_test/source/test.zip.md5 | 1 + .../plugin_test/test_local_plugin/auditdemo.jar | Bin 0 -> 2787 bytes .../test_local_plugin/plugin.properties | 26 + fe_plugins/auditdemo/pom.xml | 73 + .../auditdemo/src/main/assembly/plugin.properties | 24 + fe_plugins/auditdemo/src/main/assembly/zip.xml | 24 + .../apache/doris/plugin/audit/AuditPluginDemo.java | 54 + fe_plugins/auditloader/pom.xml | 73 + .../auditloader/src/main/assembly/plugin.conf | 24 + .../src/main/assembly/plugin.properties | 6 + fe_plugins/auditloader/src/main/assembly/zip.xml | 25 + .../doris/plugin/audit/AuditLoaderPlugin.java | 254 ++++ .../doris/plugin/audit/DorisStreamLoader.java | 151 ++ fe_plugins/pom.xml | 98 ++ .../doris/broker/hdfs/FileSystemManager.java | 7 + gensrc/thrift/AgentService.thrift | 7 + gensrc/thrift/Descriptors.thrift | 40 - gensrc/thrift/MasterService.thrift | 5 + gensrc/thrift/PaloInternalService.thrift | 2 +- gensrc/thrift/PlanNodes.thrift | 9 +- gensrc/thrift/Status.thrift | 4 +- gensrc/thrift/Types.thrift | 6 +- run-ut.sh | 9 +- .../DATETIME.md => samples/connect/cpp/README.md | 19 +- samples/connect/cpp/doris_client.cpp | 12 +- samples/connect/golang/.gitignore | 2 + .../connect/golang/README.md | 23 +- samples/connect/golang/client.go | 103 ++ .../connect/golang/go.mod | 16 +- samples/connect/java/client/.gitignore | 5 + .../connect/java/client/README.md | 16 +- samples/connect/java/client/pom.xml | 97 ++ .../java/client/src/main/java/client/Client.java | 166 +++ samples/connect/nodejs/.gitignore | 1 + .../connect/nodejs/README.md | 17 +- samples/connect/nodejs/app.js | 100 ++ samples/connect/nodejs/package-lock.json | 81 ++ samples/connect/nodejs/package.json | 14 + .../DATETIME.md => samples/connect/php/README.md | 15 +- samples/connect/php/client.php | 99 ++ .../connect/python/README.md | 15 +- samples/connect/python/connector.py | 97 ++ 368 files changed, 14420 insertions(+), 5169 deletions(-) create mode 120000 CONTRIBUTING.md create mode 120000 CONTRIBUTING_CN.md delete mode 100644 be/src/exec/kudu_scan_node.cpp delete mode 100644 be/src/exec/kudu_scan_node.h delete mode 100644 be/src/exec/kudu_scanner.cpp delete mode 100644 be/src/exec/kudu_scanner.h delete mode 100644 be/src/exec/kudu_util.cpp delete mode 100644 be/src/exec/kudu_util.h create mode 100644 be/src/exec/set_operation_node.cpp copy be/src/exec/{intersect_node.h => set_operation_node.h} (66%) copy be/{test/common => src/plugin}/CMakeLists.txt (76%) create mode 100644 be/src/plugin/plugin_loader.cpp create mode 100644 be/src/plugin/plugin_loader.h create mode 100644 be/src/plugin/plugin_mgr.cpp create mode 100644 be/src/plugin/plugin_mgr.h create mode 100644 be/src/plugin/plugin_zip.cpp copy be/src/plugin/{plugin_manager.h => plugin_zip.h} (67%) delete mode 100644 be/src/util/file_manager.cpp delete mode 100644 be/src/util/file_manager.h create mode 100644 be/test/common/config_test.cpp copy be/test/{common => plugin}/CMakeLists.txt (78%) mode change 100644 => 100755 copy be/test/{common => plugin/example}/CMakeLists.txt (81%) mode change 100644 => 100755 copy be/{src/plugin/plugin_manager.h => test/plugin/example/plugin_example.cpp} (69%) mode change 100644 => 100755 create mode 100644 be/test/plugin/plugin_loader_test.cpp create mode 100644 be/test/plugin/plugin_mgr_test.cpp create mode 100644 be/test/plugin/plugin_test/source/test.zip create mode 100755 be/test/plugin/plugin_test/source/test.zip.md5 create mode 100755 be/test/plugin/plugin_zip_test.cpp delete mode 100644 be/test/util/file_manager_test.cpp create mode 100755 build_plugin.sh create mode 100644 docs/documentation/cn/administrator-guide/materialized-view/index.rst create mode 100644 docs/documentation/cn/extending-doris/audit-plugin.md create mode 100644 docs/documentation/cn/extending-doris/plugin-development-manual.md copy docs/documentation/cn/sql-reference/sql-statements/{Data Types/DATE.md => Administration/INSTALL PLUGIN.md} (53%) copy docs/documentation/cn/sql-reference/sql-statements/{Data Types/DATETIME.md => Administration/SHOW PLUGINS.md} (74%) copy docs/documentation/cn/sql-reference/sql-statements/{Data Types/DATE.md => Administration/UNINSTALL PLUGIN.md} (70%) create mode 100644 docs/documentation/cn/sql-reference/sql-statements/Data Definition/CREATE MATERIALIZED VIEW.md create mode 100644 docs/documentation/cn/sql-reference/sql-statements/Data Definition/DROP MATERIALIZED VIEW.md create mode 100644 docs/documentation/en/extending-doris/audit-plugin_EN.md create mode 100644 docs/documentation/en/extending-doris/plugin-development-manual_EN.md copy docs/documentation/{cn/sql-reference/sql-statements/Data Types/DATE.md => en/sql-reference/sql-statements/Administration/INSTALL PLUGIN_EN.md} (55%) copy docs/documentation/{cn/sql-reference/sql-statements/Data Types/DATETIME.md => en/sql-reference/sql-statements/Administration/SHOW PLUGINS_EN.md} (75%) copy docs/documentation/{cn/sql-reference/sql-statements/Data Types/DATE.md => en/sql-reference/sql-statements/Administration/UNINTALL PLUGIN_EN.md} (71%) create mode 100644 docs/documentation/en/sql-reference/sql-statements/Data Definition/CREATE MATERIALIZED VIEW.md create mode 100644 docs/documentation/en/sql-reference/sql-statements/Data Definition/DROP MATERIALIZED VIEW.md create mode 100644 fe/src/main/java/org/apache/doris/alter/AlterOpType.java create mode 100644 fe/src/main/java/org/apache/doris/alter/AlterOperations.java copy fe/src/main/java/org/apache/doris/analysis/{FrontendClause.java => InstallPluginStmt.java} (54%) copy fe/src/main/java/org/apache/doris/analysis/{FrontendClause.java => UninstallPluginStmt.java} (54%) delete mode 100644 fe/src/main/java/org/apache/doris/catalog/KuduPartition.java delete mode 100644 fe/src/main/java/org/apache/doris/catalog/KuduTable.java create mode 100644 fe/src/main/java/org/apache/doris/common/util/DigitalVersion.java delete mode 100644 fe/src/main/java/org/apache/doris/common/util/KuduUtil.java delete mode 100644 fe/src/main/java/org/apache/doris/kudu/KuduAgent.java create mode 100644 fe/src/main/java/org/apache/doris/load/loadv2/BitmapValue.java create mode 100644 fe/src/main/java/org/apache/doris/load/loadv2/Roaring64Map.java create mode 100644 fe/src/main/java/org/apache/doris/plugin/AuditEvent.java copy fe/src/main/java/org/apache/doris/plugin/{PluginType.java => AuditPlugin.java} (64%) copy fe/src/main/java/org/apache/doris/plugin/{PluginManager.java => BuiltinPluginLoader.java} (58%) create mode 100644 fe/src/main/java/org/apache/doris/plugin/DynamicPluginLoader.java create mode 100644 fe/src/main/java/org/apache/doris/plugin/ExtendedPluginsClassLoader.java copy fe/src/main/java/org/apache/doris/plugin/{PluginType.java => PluginClassLoader.java} (76%) mode change 100644 => 100755 rename be/src/plugin/plugin_manager.h => fe/src/main/java/org/apache/doris/plugin/PluginContext.java (69%) copy fe/src/main/java/org/apache/doris/plugin/{PluginType.java => PluginException.java} (77%) create mode 100644 fe/src/main/java/org/apache/doris/plugin/PluginInfo.java create mode 100644 fe/src/main/java/org/apache/doris/plugin/PluginLoader.java create mode 100644 fe/src/main/java/org/apache/doris/plugin/PluginMgr.java create mode 100644 fe/src/main/java/org/apache/doris/plugin/PluginZip.java delete mode 100644 fe/src/main/java/org/apache/doris/qe/AuditBuilder.java create mode 100644 fe/src/main/java/org/apache/doris/qe/AuditEventProcessor.java create mode 100644 fe/src/main/java/org/apache/doris/qe/AuditLogBuilder.java create mode 100644 fe/src/test/java/org/apache/doris/alter/AlterJobV2Test.java create mode 100644 fe/src/test/java/org/apache/doris/alter/AlterTest.java create mode 100644 fe/src/test/java/org/apache/doris/analysis/StmtRewriterTest.java create mode 100644 fe/src/test/java/org/apache/doris/common/util/VersionTest.java create mode 100644 fe/src/test/java/org/apache/doris/load/loadv2/BitmapValueTest.java create mode 100644 fe/src/test/java/org/apache/doris/plugin/PluginInfoTest.java create mode 100644 fe/src/test/java/org/apache/doris/plugin/PluginLoaderTest.java create mode 100644 fe/src/test/java/org/apache/doris/plugin/PluginMgrTest.java rename fe/src/{main/java/org/apache/doris/plugin/PluginManager.java => test/java/org/apache/doris/plugin/PluginTestUtil.java} (51%) create mode 100644 fe/src/test/java/org/apache/doris/plugin/PluginZipTest.java create mode 100644 fe/src/test/java/org/apache/doris/qe/AuditEventProcessorTest.java copy fe/src/{main/java/org/apache/doris/plugin/Plugin.java => test/java/plugin/PluginTest.java} (57%) create mode 100644 fe/src/test/resources/plugin_test/auditdemo.zip create mode 100644 fe/src/test/resources/plugin_test/plugin_test.jar create mode 100644 fe/src/test/resources/plugin_test/source/plugin.properties create mode 100644 fe/src/test/resources/plugin_test/source/test.zip create mode 100644 fe/src/test/resources/plugin_test/source/test.zip.md5 create mode 100644 fe/src/test/resources/plugin_test/test_local_plugin/auditdemo.jar create mode 100644 fe/src/test/resources/plugin_test/test_local_plugin/plugin.properties create mode 100644 fe_plugins/auditdemo/pom.xml create mode 100755 fe_plugins/auditdemo/src/main/assembly/plugin.properties create mode 100644 fe_plugins/auditdemo/src/main/assembly/zip.xml create mode 100755 fe_plugins/auditdemo/src/main/java/org/apache/doris/plugin/audit/AuditPluginDemo.java create mode 100644 fe_plugins/auditloader/pom.xml create mode 100755 fe_plugins/auditloader/src/main/assembly/plugin.conf create mode 100755 fe_plugins/auditloader/src/main/assembly/plugin.properties create mode 100644 fe_plugins/auditloader/src/main/assembly/zip.xml create mode 100755 fe_plugins/auditloader/src/main/java/org/apache/doris/plugin/audit/AuditLoaderPlugin.java create mode 100644 fe_plugins/auditloader/src/main/java/org/apache/doris/plugin/audit/DorisStreamLoader.java create mode 100644 fe_plugins/pom.xml copy docs/documentation/cn/sql-reference/sql-statements/Data Types/DATETIME.md => samples/connect/cpp/README.md (67%) create mode 100644 samples/connect/golang/.gitignore copy docs/documentation/cn/sql-reference/sql-statements/Data Types/DATETIME.md => samples/connect/golang/README.md (69%) create mode 100644 samples/connect/golang/client.go rename fe/src/main/java/org/apache/doris/plugin/PluginType.java => samples/connect/golang/go.mod (80%) create mode 100644 samples/connect/java/client/.gitignore copy docs/documentation/cn/sql-reference/sql-statements/Data Types/DATETIME.md => samples/connect/java/client/README.md (75%) create mode 100644 samples/connect/java/client/pom.xml create mode 100644 samples/connect/java/client/src/main/java/client/Client.java create mode 100644 samples/connect/nodejs/.gitignore copy docs/documentation/en/sql-reference/sql-statements/Data Types/DATETIME_EN.md => samples/connect/nodejs/README.md (80%) create mode 100644 samples/connect/nodejs/app.js create mode 100644 samples/connect/nodejs/package-lock.json create mode 100644 samples/connect/nodejs/package.json copy docs/documentation/cn/sql-reference/sql-statements/Data Types/DATETIME.md => samples/connect/php/README.md (75%) create mode 100644 samples/connect/php/client.php copy docs/documentation/cn/sql-reference/sql-statements/Data Types/DATETIME.md => samples/connect/python/README.md (78%) create mode 100755 samples/connect/python/connector.py --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org