This is an automated email from the ASF dual-hosted git repository.
ColinLeeo pushed a change to branch fix/table-udf-result-chunking
in repository https://gitbox.apache.org/repos/asf/iotdb.git
omit c380a825a1a Remove redundant table UDF split condition
omit 356c516b0f4 Clarify table UDF result size accounting
omit c8c4b3df293 Estimate table UDF result blocks by memory size
omit 6f7c588e50f Optimize table UDF result block splitting
omit 0d46ba8d592 Fix table UDF result splitting after pass-through
omit 82c40ee3a9a Fix table UDF result block splitting
add 02b1ecd3775 [Performance] Allocate AlignedTVList primitive arrays
lazily (#18276)
add f7be88e0c48 Added table metric & Improved the database / view metric &
Added "count databases" for table model (#15587)
add e9687382c8a Move state machine to calc commons (#18289)
add 1000f953840 Remove deprecated-for-removal JDK API usages (#18288)
add ed8cb435b94 Fix IPv6 endpoint handling in client and ops tools (#18291)
add d9040c037bd Return one NULL row for last_by over a never-written device
add 47f71715238 [Pipe] Fairly limit concurrent TsFile parsers (#18260)
add 965e8635a48 Fix inexact varargs calls (#18294)
add 939500d0990 Fix grouped max for non-positive floating-point values
(#18300)
add b4da74291db Remove obsolete DataNode audit log appender (#18292)
add 165cd4cafd2 Improve error messages for unsupported __audit database
operations (#18309)
add 1eb7c30faa2 [Pipe] Use buffered input for TsFile scan parser (#18254)
add d29dcf8247a Track null value ratio of flushed MemTables (#18287)
add 53d701c433f Fix concurrent access to IoTConsensus configuration
(#18290)
add 59f349c9844 [Pipe] Preserve parser fairness and OOM retry state
(#18305)
add 5adcc2c5f88 Reject database paths with empty nodes on ConfigNode
(#18308)
add 892dbd85bab Fix floating-point sentinel misuse in KDTree and SDT
(#18302)
add 2fd1fe3fda4 support the retry for the execution the insert path in
statemachine with DN metadata fenced and retry for coordinator (#18301)
add 39e2ad07882 [Load] Handle empty path nodes during database
auto-creation (#18307)
add cb6a309521d Fix Region recovery validation before DataNode startup
success (#18311)
add 8c68dd71f86 Optimize pipe request serialization buffer sizing (#18233)
add 11aa5069a6d Prevent pipe receiver statement exception log floods
(#18318)
add 3cf99bd9fa0 Fix IoTConsensus SyncLog retry handling (#18317)
add 913104e741e Fix flaky pipe idempotent table IT (#18316)
add fe77cf1e0ae Fix invalid WAL throttle threshold persistence (#18327)
add f3d111c78a6 Reject NaN disk space warning threshold on hot reload
(#18326)
add 98a7d511a78 Avoid stale Poetry cache when locking AINode dependencies
(#18329)
add b008bd6e03d Add CorruptedTsFileException for TsFile corruption errors
with file path (#18304)
add 44b2cf5676a [Subscription] Bound consensus prefetch memory usage
(#18298)
add 23201f223ca Fix WAL throttle threshold fallback on hot reload (#18336)
add 343acc440f7 Fix region migration IT memory proportions (#18337)
add 834418ed5ed [Pipe] Improve timeout diagnostics and DROP PIPE
observability (#18297)
add 39a20ce31b4 Fix table device recovery from schema snapshots (#18324)
add 9e909d3ce26 [Fix] Reconcile actual aligned TVList memory usage (#18330)
add 55a53f6d6fd [Pipe] Relax flaky TsFile event test timeouts (#18332)
add 8d5da83f0df Preserve Pipe sink exception root causes (#18335)
add 7e0812a9881 Fix procedure metrics before executor initialization
(#18338)
add 486102749dd Bump at.yawk.lz4:lz4-java from 1.10.1 to 1.11.1 (#18322)
add f3f7d125fe0 [Pipe] Fix TsFile rate limit accounting (#18344)
add f39d0e932cf Fix oversized audit logs for tree batch writes (#18345)
add 410ab85f2ae Fix corrupted TsFile IT file selection (#18346)
add 847cc6d1848 Fix ConfigNode leader transfer retries during removal
(#18348)
add 2882aa9fbc2 Fix retry for schema query internal writes (#18296)
add a6ac4cba687 [Pipe] Release tablet memory before closing TsFile scan
parser (#18350)
add 85711da2091 Fix table function audit operation type (#18351)
add 3fd6e26eb32 fix(consensus): preserve SyncLog retry ordering (#18323)
add a8497bef9ff Record audit log when updating user password (#18357)
add 17e4efb6922 Record audit logs when revoke failed (#18352)
add 3a06ed41d5d Disable multi-node REMOVE statements (#18360)
add 647e5363152 Remove Ratis region migration rate limiting (#18365)
add 71700468942 [Pipe] Fix historical TsFile schema recovery race (#18314)
add 6559aa52ba9 Pipe: Handle hybrid meta progress indexes (#18331)
add 8b9f1d23a7e Fix table UDF result block splitting
add 507ab082551 Fix table UDF result splitting after pass-through
add 2962df6729f Optimize table UDF result block splitting
add dfa312d2d36 Estimate table UDF result blocks by memory size
add 608536ee1e8 Clarify table UDF result size accounting
add 40eed71fd33 Remove redundant table UDF split condition
add 03b243239cf Reuse AbstractOperator for table UDF result splitting
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (c380a825a1a)
\
N -- N -- N refs/heads/fix/table-udf-result-chunking
(03b243239cf)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
LICENSE-binary | 2 +-
.../rest/protocol/filter/AuthorizationFilter.java | 7 +-
.../protocol/handler/AuthorizationHandler.java | 16 +-
.../rest/protocol/v1/impl/RestApiServiceImpl.java | 3 +-
.../rest/protocol/v2/impl/RestApiServiceImpl.java | 3 +-
.../apache/iotdb/itbase/constant/TestConstant.java | 2 +-
.../IoTDBRegionMigrateNormalITForIoTV2BatchIT.java | 2 +-
.../IoTDBRemoveConfigNodeITFramework.java | 20 +-
.../IoTDBRemoveDataNodeNormalIT.java | 7 -
.../db/it/IoTDBAlignedTVListLazyAllocationIT.java | 139 ++++
.../iotdb/db/it/IoTDBSetConfigurationIT.java | 42 ++
.../iotdb/db/it/auth/IoTDBSeriesPermissionIT.java | 2 +-
.../iotdb/db/it/auth/IoTDBTemplateAuthIT.java | 7 +-
...DBAlignedTVListPrimitiveArrayPerformanceIT.java | 584 ++++++++++++++++
.../db/it/udf/IoTDBUDTFBuiltinFunctionIT.java | 4 +-
.../manual/enhanced/IoTDBPipeIdempotentIT.java | 3 +
.../auto/enhanced/IoTDBPipeAutoConflictIT.java | 5 +
.../it/db/it/IoTDBAuthenticationTableIT.java | 9 +
.../relational/it/db/it/IoTDBDeletionTableIT.java | 114 ++++
.../recent/IoTDBQueryWithCorruptedTsFileIT.java | 355 ++++++++++
.../it/query/recent/IoTDBTableAggregationIT.java | 15 +
.../it/schema/IoTDBAlterColumnTypeIT.java | 9 +-
.../relational/it/schema/IoTDBDatabaseIT.java | 3 +
.../en/org/apache/iotdb/cli/i18n/CliMessages.java | 6 +
.../zh/org/apache/iotdb/cli/i18n/CliMessages.java | 6 +
.../src/main/java/org/apache/iotdb/cli/Cli.java | 19 +-
.../apache/iotdb/tool/data/ExportDataTable.java | 3 +-
.../org/apache/iotdb/tool/data/ImportData.java | 3 +-
.../apache/iotdb/tool/data/ImportDataTable.java | 8 +-
.../iotdb/tool/schema/ExportSchemaTable.java | 3 +-
.../iotdb/tool/schema/ImportSchemaTable.java | 3 +-
.../java/org/apache/iotdb/rpc/TSStatusCode.java | 5 +-
.../main/java/org/apache/iotdb/rpc/UrlUtils.java | 8 +
.../java/org/apache/iotdb/rpc/UrlUtilsTest.java | 3 +
iotdb-core/ainode/build_binary.py | 5 +-
.../org/apache/iotdb/db/qp/sql/IoTDBSqlParser.g4 | 2 +-
.../org/apache/iotdb/calc/i18n/CalcMessages.java | 20 +
.../org/apache/iotdb/calc/i18n/CalcMessages.java | 20 +
.../iotdb/calc}/execution/FutureStateChange.java | 6 +-
.../apache/iotdb/calc}/execution/StateMachine.java | 55 +-
.../process/function/TableFunctionOperator.java | 178 +----
.../aggregation/grouped/GroupedMaxAccumulator.java | 4 +-
.../aggregation/GroupedMaxAccumulatorTest.java | 124 ++++
.../iotdb/confignode/i18n/ConfigNodeMessages.java | 8 +
.../iotdb/confignode/i18n/ManagerMessages.java | 6 +
.../iotdb/confignode/i18n/ProcedureMessages.java | 31 +-
.../iotdb/confignode/i18n/ConfigNodeMessages.java | 8 +
.../iotdb/confignode/i18n/ManagerMessages.java | 6 +
.../iotdb/confignode/i18n/ProcedureMessages.java | 43 +-
.../iotdb/confignode/manager/ConfigManager.java | 13 +
.../iotdb/confignode/manager/ProcedureManager.java | 72 +-
.../iotdb/confignode/manager/node/NodeManager.java | 79 ++-
.../manager/partition/PartitionMetrics.java | 94 ++-
.../pipe/agent/task/PipeConfigNodeTaskAgent.java | 12 +-
.../runtime/heartbeat/PipeHeartbeatParser.java | 8 +
.../manager/schema/ClusterSchemaManager.java | 9 +
.../confignode/persistence/pipe/PipeTaskInfo.java | 58 +-
.../schema/CNPhysicalPlanGenerator.java | 2 +-
.../persistence/schema/ClusterSchemaInfo.java | 87 ++-
.../confignode/persistence/schema/ConfigMTree.java | 29 +-
.../persistence/schema/ConfigSchemaStatistics.java | 109 +++
.../confignode/procedure/ProcedureExecutor.java | 25 +-
.../procedure/env/ConfigNodeProcedureEnv.java | 66 +-
.../procedure/impl/StateMachineProcedure.java | 11 +
.../impl/pipe/AbstractOperatePipeProcedureV2.java | 211 +++++-
.../impl/pipe/runtime/PipeMetaSyncProcedure.java | 4 +
.../impl/pipe/task/AlterPipeProcedureV2.java | 2 +-
.../impl/pipe/task/DropPipeProcedureV2.java | 48 +-
.../impl/schema/DeleteDatabaseProcedure.java | 2 +
.../confignode/procedure/scheduler/LockQueue.java | 6 +-
.../request/ConfigPhysicalPlanSerDeTest.java | 2 +-
.../consensus/response/pipe/PipeTableRespTest.java | 12 +
.../confignode/manager/node/NodeManagerTest.java | 189 ++++++
.../runtime/heartbeat/PipeHeartbeatParserTest.java | 36 +
.../pipe/PipeTaskInfoAutoRestartTest.java | 41 ++
.../persistence/schema/ClusterSchemaInfoTest.java | 57 ++
.../persistence/schema/ConfigMTreeTest.java | 8 +-
.../procedure/TestProcedureExecutor.java | 28 +
.../pipe/AbstractOperatePipeProcedureV2Test.java | 31 +
.../impl/pipe/task/DropPipeProcedureV2Test.java | 154 +++++
.../iotdb/consensus/i18n/IoTConsensusMessages.java | 6 +
.../consensus/i18n/IoTConsensusV2Messages.java | 3 -
.../iotdb/consensus/i18n/IoTConsensusMessages.java | 6 +
.../consensus/i18n/IoTConsensusV2Messages.java | 3 -
.../apache/iotdb/consensus/iot/IoTConsensus.java | 5 +-
.../consensus/iot/IoTConsensusServerImpl.java | 44 +-
.../iotdb/consensus/pipe/IoTConsensusV2.java | 88 +--
.../ratis/ApplicationStateMachineProxy.java | 32 +-
.../consensus/ratis/RateLimitedGrpcFactory.java | 40 --
.../ratis/RateLimitedGrpcLogAppender.java | 76 ---
.../consensus/ratis/RateLimitedGrpcRpcType.java | 37 --
.../iotdb/consensus/ratis/RatisConsensus.java | 2 -
.../consensus/iot/IoTConsensusServerImplTest.java | 162 +++++
.../apache/iotdb/consensus/iot/ReplicateTest.java | 189 ++++++
.../iotdb/consensus/pipe/IoTConsensusV2Test.java | 55 ++
.../ratis/RateLimitedGrpcLogAppenderTest.java | 66 --
.../assembly/resources/conf/logback-datanode.xml | 18 -
.../apache/iotdb/db/i18n/DataNodeMiscMessages.java | 14 +-
.../apache/iotdb/db/i18n/DataNodePipeMessages.java | 6 +-
.../iotdb/db/i18n/DataNodeQueryMessages.java | 39 +-
.../iotdb/db/i18n/DataNodeSchemaMessages.java | 1 +
.../iotdb/db/i18n/StorageEngineMessages.java | 13 +-
.../apache/iotdb/db/i18n/DataNodeMiscMessages.java | 14 +-
.../apache/iotdb/db/i18n/DataNodePipeMessages.java | 6 +-
.../iotdb/db/i18n/DataNodeQueryMessages.java | 39 +-
.../iotdb/db/i18n/DataNodeSchemaMessages.java | 1 +
.../iotdb/db/i18n/StorageEngineMessages.java | 13 +-
.../org/apache/iotdb/db/audit/DNAuditLogger.java | 261 +++++++-
.../iotdb/db/audit/PasswordChangeAuditContext.java | 187 ++++++
.../iotdb/db/audit/PasswordChangeAuditTask.java | 87 +++
.../org/apache/iotdb/db/auth/AuthorityChecker.java | 27 +-
.../apache/iotdb/db/conf/DataNodeMemoryConfig.java | 137 ++--
.../org/apache/iotdb/db/conf/IoTDBDescriptor.java | 9 +
.../db/consensus/SchemaRegionConsensusImpl.java | 25 +-
.../dataregion/DataExecutionVisitor.java | 11 +
.../dataregion/DataRegionStateMachine.java | 14 +-
.../db/exception/CorruptedTsFileException.java | 70 ++
.../db/pipe/agent/task/PipeDataNodeTaskAgent.java | 10 +-
.../task/builder/PipeDataNodeTaskBuilder.java | 56 +-
.../agent/task/subtask/sink/PipeSinkSubtask.java | 2 +-
.../tablet/PipeInsertNodeTabletInsertionEvent.java | 61 +-
.../common/tsfile/PipeTsFileInsertionEvent.java | 123 ++--
.../scan/TsFileInsertionEventScanParser.java | 40 +-
...ileInsertionEventTableParserTabletIterator.java | 48 +-
.../processor/aggregate/AggregateProcessor.java | 16 +-
.../sdt/SwingingDoorTrendingFilter.java | 8 +-
.../twostage/plugin/TwoStageCountProcessor.java | 29 +-
.../protocol/thrift/IoTDBDataNodeReceiver.java | 107 ++-
.../resource/memory/InsertNodeMemoryEstimator.java | 16 +-
.../db/pipe/resource/memory/PipeMemoryManager.java | 351 +++++++++-
.../evolvable/batch/PipeTabletEventPlainBatch.java | 24 +-
.../request/PipeTransferTabletBatchReq.java | 27 +-
.../request/PipeTransferTabletBatchReqV2.java | 43 +-
.../request/PipeTransferTabletBinaryReq.java | 14 +-
.../request/PipeTransferTabletBinaryReqV2.java | 28 +-
.../request/PipeTransferTabletInsertNodeReq.java | 20 +-
.../request/PipeTransferTabletInsertNodeReqV2.java | 16 +-
.../request/PipeTransferTabletRawReq.java | 13 +-
.../request/PipeTransferTabletRawReqV2.java | 14 +-
.../request/PipeTransferTsFileSealWithModReq.java | 72 +-
.../protocol/airgap/IoTDBDataRegionAirGapSink.java | 11 +-
.../IoTConsensusV2TransferBatchReqBuilder.java | 12 +-
.../request/IoTConsensusV2TabletInsertNodeReq.java | 6 +
.../async/handler/PipeTransferTsFileHandler.java | 30 +-
.../thrift/sync/IoTDBDataRegionSyncSink.java | 20 +-
...istoricalDataRegionTsFileAndDeletionSource.java | 17 +-
.../db/protocol/session/RestClientSession.java | 6 +-
.../protocol/thrift/impl/ClientRPCServiceImpl.java | 10 +-
.../db/queryengine/common/MPPQueryContext.java | 6 +-
.../queryengine/execution/QueryStateMachine.java | 1 +
.../fragment/FragmentInstanceStateMachine.java | 4 +-
.../execution/operator/source/FileLoaderUtils.java | 65 +-
.../execution/operator/source/SeriesScanUtil.java | 43 +-
.../execution/schedule/AbstractDriverThread.java | 28 +-
.../iotdb/db/queryengine/plan/Coordinator.java | 77 ++-
.../analyze/cache/partition/PartitionCache.java | 4 +-
.../plan/analyze/load/LoadTsFileAnalyzer.java | 25 +-
.../load/TreeSchemaAutoCreatorAndVerifier.java | 37 +-
.../plan/analyze/schema/ISchemaFetcher.java | 19 +
.../plan/analyze/schema/SchemaValidator.java | 34 +-
.../execution/config/TableConfigTaskVisitor.java | 40 +-
.../execution/config/TreeConfigTaskVisitor.java | 30 +-
.../config/metadata/CountDatabaseTask.java | 4 +-
.../db/queryengine/plan/parser/ASTVisitor.java | 3 +-
.../planner/DataNodeTableOperatorGenerator.java | 13 +-
.../plan/planner/plan/PlanFragment.java | 4 +
.../plan/node/pipe/PipeEnrichedInsertNode.java | 16 +
.../plan/node/write/InsertMultiTabletsNode.java | 9 +
.../plan/planner/plan/node/write/InsertNode.java | 45 ++
.../planner/plan/node/write/InsertRowNode.java | 67 ++
.../planner/plan/node/write/InsertRowsNode.java | 15 +
.../plan/node/write/InsertRowsOfOneDeviceNode.java | 10 +
.../planner/plan/node/write/InsertTabletNode.java | 83 +++
.../plan/node/write/RelationalInsertRowNode.java | 5 +
.../node/write/RelationalInsertTabletNode.java | 11 +
.../read_tsfile/ExternalTsFileQueryResource.java | 100 ++-
.../metadata/fetcher/TableDeviceSchemaFetcher.java | 2 +-
.../cache/TreeDeviceSchemaCacheManager.java | 4 +-
.../node/schema/TableSchemaQueryWriteVisitor.java | 31 +-
.../plan/relational/security/AccessControl.java | 13 +
.../relational/security/AccessControlImpl.java | 27 +-
.../relational/security/AllowAllAccessControl.java | 7 +
.../relational/security/ITableAuthChecker.java | 13 +
.../relational/security/ITableAuthCheckerImpl.java | 41 +-
.../security/TreeAccessCheckVisitor.java | 178 +++--
.../plan/relational/sql/ast/LoadTsFile.java | 9 +
.../plan/relational/sql/parser/AstBuilder.java | 3 +-
.../scheduler/FragmentInstanceDispatcherImpl.java | 2 +
.../plan/statement/crud/InsertBaseStatement.java | 46 ++
.../crud/InsertMultiTabletsStatement.java | 11 +
.../plan/statement/crud/InsertRowsStatement.java | 29 +
.../plan/statement/crud/LoadTsFileStatement.java | 18 +
.../apache/iotdb/db/schemaengine/SchemaEngine.java | 9 +-
.../schemaengine/lease/MetadataLeaseManager.java | 6 +-
.../schemaengine/metric/ISchemaEngineMetric.java | 7 +-
.../schemaengine/metric/ISchemaRegionMetric.java | 7 +-
.../metric/SchemaEngineCachedMetric.java | 10 +
.../schemaengine/metric/SchemaEngineMemMetric.java | 34 +-
.../schemaengine/metric/SchemaMetricManager.java | 4 +
.../metric/SchemaRegionCachedMetric.java | 10 +
.../schemaengine/metric/SchemaRegionMemMetric.java | 56 ++
.../rescon/ISchemaEngineStatistics.java | 2 +
.../rescon/MemSchemaEngineStatistics.java | 43 ++
.../rescon/MemSchemaRegionStatistics.java | 25 +-
.../impl/mem/snapshot/MemMTreeSnapshotUtil.java | 15 +-
.../db/schemaengine/table/DataNodeTableCache.java | 59 +-
.../iotdb/db/schemaengine/table/ITableCache.java | 7 +
.../java/org/apache/iotdb/db/service/DataNode.java | 13 +-
.../iotdb/db/service/metrics/WritingMetrics.java | 23 +-
.../metrics/memory/QueryEngineMemoryMetrics.java | 26 +-
.../iotdb/db/storageengine/StorageEngine.java | 6 +-
.../db/storageengine/dataregion/DataRegion.java | 10 +-
.../dataregion/memtable/AbstractMemTable.java | 74 ++-
.../memtable/AlignedWritableMemChunk.java | 4 +
.../dataregion/memtable/IMemTable.java | 9 +
.../dataregion/memtable/TsFileProcessor.java | 529 +++++++++++----
.../read/reader/chunk/DiskAlignedChunkLoader.java | 5 +
.../read/reader/chunk/DiskChunkLoader.java | 5 +
.../load/active/ActiveLoadPathHelper.java | 10 +
.../load/config/LoadTsFileConfigurator.java | 23 +
.../broker/ConsensusSubscriptionBroker.java | 21 +-
.../consensus/ConsensusPrefetchingQueue.java | 734 ++++++++++++++++-----
.../SubscriptionDataNodeResourceManager.java | 6 +
.../resource/SubscriptionMemoryManager.java | 89 +++
.../apache/iotdb/db/utils/ErrorHandlingUtils.java | 3 +-
.../db/utils/datastructure/AlignedTVList.java | 294 ++++++---
.../iotdb/db/utils/datastructure/TVList.java | 13 +-
.../db/audit/DNAuditLoggerRevokeFailureTest.java | 183 +++++
.../apache/iotdb/db/audit/DNAuditLoggerTest.java | 181 +++++
.../db/audit/PasswordChangeAuditContextTest.java | 327 +++++++++
.../apache/iotdb/db/auth/AuthorityCheckerTest.java | 25 +-
.../org/apache/iotdb/db/auth/TreeAccessTest.java | 55 ++
.../iotdb/db/conf/DataNodeMemoryConfigTest.java | 67 ++
.../org/apache/iotdb/db/conf/PropertiesTest.java | 56 ++
.../dataregion/DataRegionStateMachineTest.java | 143 ++++
.../schemaRegion/SchemaRegionManagementTest.java | 38 ++
.../task/builder/PipeDataNodeTaskBuilderTest.java | 79 +++
.../task/subtask/sink/PipeSinkSubtaskTest.java | 93 +++
.../pipe/event/PipeTsFileInsertionEventTest.java | 9 +-
.../pipe/event/TsFileInsertionEventParserTest.java | 60 ++
.../PipeTsFileInsertionEventAdmissionTest.java | 67 +-
.../sdt/SwingingDoorTrendingFilterTest.java | 17 +
.../plugin/TwoStageCountProcessorTest.java | 55 ++
.../protocol/thrift/IoTDBDataNodeReceiverTest.java | 115 +++-
.../resource/memory/PipeMemoryManagerTest.java | 384 +++++++++++
.../pipe/sink/PipeDataNodeThriftRequestTest.java | 13 +
.../request/PipeTransferSerializationSizeTest.java | 530 +++++++++++++++
.../airgap/IoTDBDataRegionAirGapSinkTest.java | 17 +-
.../PipeTransferTsFileHandlerRateLimitTest.java | 83 +++
.../process/tvf/TableFunctionOperatorTest.java | 333 ++++------
.../plan/analyze/load/LoadTsFileAnalyzerTest.java | 136 ++++
...est.java => RemoveNodeSingleNodeParseTest.java} | 27 +-
.../node/write/InsertRowsNodeSerdeTest.java | 26 +
.../plan/relational/analyzer/AuthTest.java | 51 ++
.../schema/TableSchemaQueryWriteVisitorTest.java | 89 +++
...java => RemoveNodeSingleNodeStatementTest.java} | 25 +-
.../statement/crud/InsertBaseStatementTest.java | 88 +++
.../schemaengine/lease/MetadataLeaseTestUtils.java | 9 +-
.../table/DataNodeTableCacheLeaseTest.java | 24 +-
.../TsFileResourceProgressIndexTest.java | 9 +
.../AbstractMemTablePartialInsertTest.java | 87 ++-
...ignedBitmapMemoryAccountingPerformanceTest.java | 295 +++++++++
.../dataregion/memtable/TsFileProcessorTest.java | 221 ++++++-
.../load/active/ActiveLoadDirScannerTest.java | 2 +-
.../load/active/ActiveLoadPathHelperTest.java | 29 +-
...onsensusPrefetchingQueueDataNodeMemoryTest.java | 346 ++++++++++
.../consensus/ConsensusPrefetchingQueueTest.java | 695 ++++++++++++++++++-
...nsensusPrefetchingQueueWalBackpressureTest.java | 336 ++++++++++
.../resource/SubscriptionMemoryManagerTest.java | 64 ++
.../db/utils/datastructure/AlignedTVListTest.java | 167 +++++
.../src/test/resources/datanode1conf/logback.xml | 18 -
.../src/test/resources/datanode2conf/logback.xml | 18 -
.../src/test/resources/datanode3conf/logback.xml | 18 -
.../conf/iotdb-system.properties.template | 21 +-
.../apache/iotdb/commons/i18n/PipeMessages.java | 6 +
.../apache/iotdb/commons/i18n/PipeMessages.java | 6 +
.../iotdb/commons/concurrent/IoTThreadFactory.java | 3 +-
.../apache/iotdb/commons/conf/CommonConfig.java | 40 ++
.../iotdb/commons/conf/CommonDescriptor.java | 4 +-
.../apache/iotdb/commons/conf/IoTDBConstant.java | 1 -
.../commons/consensus/index/ProgressIndex.java | 10 +
.../consensus/index/impl/HybridProgressIndex.java | 25 +
.../consensus/index/impl/IoTProgressIndex.java | 9 +
.../consensus/index/impl/MetaProgressIndex.java | 9 +
.../consensus/index/impl/MinimumProgressIndex.java | 9 +
.../consensus/index/impl/RecoverProgressIndex.java | 9 +
.../consensus/index/impl/SimpleProgressIndex.java | 9 +
.../consensus/index/impl/StateProgressIndex.java | 9 +
.../index/impl/TimePartitionProgressIndex.java | 9 +
.../index/impl/TimeWindowStateProgressIndex.java | 11 +-
.../exception/MetadataLeaseFencedException.java | 21 +-
.../pipe/PipeRuntimeCriticalException.java | 4 +
.../exception/pipe/PipeRuntimeException.java | 4 +
.../pipe/PipeRuntimeSinkCriticalException.java | 4 +
.../commons/pipe/agent/task/PipeTaskAgent.java | 6 +
.../commons/pipe/agent/task/meta/PipeStatus.java | 3 +
.../task/subtask/PipeAbstractSinkSubtask.java | 10 +-
.../iotdb/commons/pipe/config/PipeConfig.java | 14 +
.../iotdb/commons/pipe/config/PipeDescriptor.java | 10 +
.../pipe/config/constant/SystemConstant.java | 3 +
.../options/PipeInclusionOptions.java | 15 +
.../pipe/sink/protocol/IoTDBAirGapSink.java | 2 +-
.../commons/pipe/sink/protocol/IoTDBSink.java | 8 +
.../pipe/sink/protocol/IoTDBSslSyncSink.java | 2 +-
.../pipe/source/IoTDBNonDataRegionSource.java | 45 +-
.../plan/planner/plan/node/PlanNode.java | 8 +
.../iotdb/commons/service/metric/enums/Metric.java | 2 +
.../apache/iotdb/commons/udf/utils/KDTreeUtil.java | 10 +-
.../org/apache/iotdb/commons/utils/RetryUtils.java | 2 +
.../apache/iotdb/commons/utils/StatusUtils.java | 1 +
...monDescriptorDiskSpaceWarningThresholdTest.java | 2 +-
.../commons/consensus/index/ProgressIndexTest.java | 82 +++
.../pipe/source/IoTDBNonDataRegionSourceTest.java | 172 +++++
.../iotdb/commons/pipe/task/PipeMetaDeSerTest.java | 13 +
.../iotdb/commons/udf/utils/KDTreeUtilTest.java} | 30 +-
.../iotdb/commons/utils/RetryStatusUtilsTest.java} | 25 +-
.../iotdb/commons/utils/RetryUtilsTest.java} | 25 +-
.../db/relational/grammar/sql/RelationalSql.g4 | 2 +-
pom.xml | 2 +-
scripts/tools/ops/health_check.sh | 8 +-
scripts/tools/windows/ops/backup.bat | 16 +-
scripts/tools/windows/ops/health_check.bat | 41 +-
322 files changed, 14259 insertions(+), 2153 deletions(-)
create mode 100644
integration-test/src/test/java/org/apache/iotdb/db/it/IoTDBAlignedTVListLazyAllocationIT.java
create mode 100644
integration-test/src/test/java/org/apache/iotdb/db/it/performance/IoTDBAlignedTVListPrimitiveArrayPerformanceIT.java
create mode 100644
integration-test/src/test/java/org/apache/iotdb/relational/it/query/recent/IoTDBQueryWithCorruptedTsFileIT.java
rename iotdb-core/{datanode/src/main/java/org/apache/iotdb/db/queryengine =>
calc-commons/src/main/java/org/apache/iotdb/calc}/execution/FutureStateChange.java
(92%)
rename iotdb-core/{datanode/src/main/java/org/apache/iotdb/db/queryengine =>
calc-commons/src/main/java/org/apache/iotdb/calc}/execution/StateMachine.java
(85%)
create mode 100644
iotdb-core/calc-commons/src/test/java/org/apache/iotdb/calc/execution/operator/source/relational/aggregation/GroupedMaxAccumulatorTest.java
create mode 100644
iotdb-core/confignode/src/main/java/org/apache/iotdb/confignode/persistence/schema/ConfigSchemaStatistics.java
create mode 100644
iotdb-core/confignode/src/test/java/org/apache/iotdb/confignode/manager/node/NodeManagerTest.java
delete mode 100644
iotdb-core/consensus/src/main/java/org/apache/iotdb/consensus/ratis/RateLimitedGrpcFactory.java
delete mode 100644
iotdb-core/consensus/src/main/java/org/apache/iotdb/consensus/ratis/RateLimitedGrpcLogAppender.java
delete mode 100644
iotdb-core/consensus/src/main/java/org/apache/iotdb/consensus/ratis/RateLimitedGrpcRpcType.java
create mode 100644
iotdb-core/consensus/src/test/java/org/apache/iotdb/consensus/iot/IoTConsensusServerImplTest.java
create mode 100644
iotdb-core/consensus/src/test/java/org/apache/iotdb/consensus/pipe/IoTConsensusV2Test.java
delete mode 100644
iotdb-core/consensus/src/test/java/org/apache/iotdb/consensus/ratis/RateLimitedGrpcLogAppenderTest.java
create mode 100644
iotdb-core/datanode/src/main/java/org/apache/iotdb/db/audit/PasswordChangeAuditContext.java
create mode 100644
iotdb-core/datanode/src/main/java/org/apache/iotdb/db/audit/PasswordChangeAuditTask.java
create mode 100644
iotdb-core/datanode/src/main/java/org/apache/iotdb/db/exception/CorruptedTsFileException.java
create mode 100644
iotdb-core/datanode/src/main/java/org/apache/iotdb/db/subscription/resource/SubscriptionMemoryManager.java
create mode 100644
iotdb-core/datanode/src/test/java/org/apache/iotdb/db/audit/DNAuditLoggerRevokeFailureTest.java
create mode 100644
iotdb-core/datanode/src/test/java/org/apache/iotdb/db/audit/DNAuditLoggerTest.java
create mode 100644
iotdb-core/datanode/src/test/java/org/apache/iotdb/db/audit/PasswordChangeAuditContextTest.java
create mode 100644
iotdb-core/datanode/src/test/java/org/apache/iotdb/db/pipe/resource/memory/PipeMemoryManagerTest.java
create mode 100644
iotdb-core/datanode/src/test/java/org/apache/iotdb/db/pipe/sink/payload/evolvable/request/PipeTransferSerializationSizeTest.java
create mode 100644
iotdb-core/datanode/src/test/java/org/apache/iotdb/db/pipe/sink/protocol/thrift/async/handler/PipeTransferTsFileHandlerRateLimitTest.java
rename
iotdb-core/datanode/src/test/java/org/apache/iotdb/db/queryengine/plan/parser/{RemoveDataNodeMultiNodeParseTest.java
=> RemoveNodeSingleNodeParseTest.java} (66%)
create mode 100644
iotdb-core/datanode/src/test/java/org/apache/iotdb/db/queryengine/plan/relational/planner/node/schema/TableSchemaQueryWriteVisitorTest.java
rename
iotdb-core/datanode/src/test/java/org/apache/iotdb/db/queryengine/plan/relational/sql/parser/{RemoveDataNodeMultiNodeStatementTest.java
=> RemoveNodeSingleNodeStatementTest.java} (70%)
create mode 100644
iotdb-core/datanode/src/test/java/org/apache/iotdb/db/queryengine/plan/statement/crud/InsertBaseStatementTest.java
create mode 100644
iotdb-core/datanode/src/test/java/org/apache/iotdb/db/storageengine/dataregion/memtable/AlignedBitmapMemoryAccountingPerformanceTest.java
create mode 100644
iotdb-core/datanode/src/test/java/org/apache/iotdb/db/subscription/broker/consensus/ConsensusPrefetchingQueueDataNodeMemoryTest.java
create mode 100644
iotdb-core/datanode/src/test/java/org/apache/iotdb/db/subscription/broker/consensus/ConsensusPrefetchingQueueWalBackpressureTest.java
create mode 100644
iotdb-core/datanode/src/test/java/org/apache/iotdb/db/subscription/resource/SubscriptionMemoryManagerTest.java
create mode 100644
iotdb-core/node-commons/src/test/java/org/apache/iotdb/commons/consensus/index/ProgressIndexTest.java
create mode 100644
iotdb-core/node-commons/src/test/java/org/apache/iotdb/commons/pipe/source/IoTDBNonDataRegionSourceTest.java
copy
iotdb-core/{calc-commons/src/test/java/org/apache/iotdb/calc/execution/operator/process/fill/filter/FixedIntervalFillFilterTest.java
=>
node-commons/src/test/java/org/apache/iotdb/commons/udf/utils/KDTreeUtilTest.java}
(55%)
copy
iotdb-core/{datanode/src/test/java/org/apache/iotdb/db/exception/mpp/FragmentInstanceDispatchExceptionTest.java
=>
node-commons/src/test/java/org/apache/iotdb/commons/utils/RetryStatusUtilsTest.java}
(54%)
copy
iotdb-core/{datanode/src/test/java/org/apache/iotdb/db/queryengine/execution/aggregation/slidingwindow/SlidingWindowAggregatorFactoryTest.java
=>
node-commons/src/test/java/org/apache/iotdb/commons/utils/RetryUtilsTest.java}
(51%)
