This is an automated email from the ASF dual-hosted git repository.
marklau99 pushed a change to branch wal-compress-formal-branch
in repository https://gitbox.apache.org/repos/asf/iotdb.git
discard ee767637a94 Edit according to comment
discard 0e0236650d4 Indicate the encoding of String
omit 7201ed68fbe reuse the byte buffer if possible
omit b99c977c1e7 clean the code to make it more readable
omit 19764fac72e add hot reload
omit dd618570703 add test for wal compression
omit 75afa659991 fix test
omit 6e2dcb27f55 edit with review
omit a9b30dc56af fix with comment
omit 93a6482552c may be fix the bug
omit 33b872c7854 add the size of magic string
omit fa2c12b5345 close wal file when the origin size of wal buffer is
larger than threshold
omit 8c9a8e60d18 optimize calculating of wal size
omit 4d39a6f44a4 fix wal ut
omit 4161155c833 set default to uncompress
omit aa88a1b5d66 fix test
omit 2624ba6588b fix ut
omit 5c0e6561d02 use compression rate to update wal disk usage
omit 04979bd0c79 remove one configuration
omit cf0af96879e remove useless log
omit eb5b5b2146e fix bug
omit b0464226cf0 temp for debug
omit 06dfd7166e7 add log for WAL size
omit 208c16accdb edit configuration item
omit 39e3989888d support multi version WAL
omit e09008d78ab support compression type in WAL Compress Header
omit bb27b9488c9 recover some code
omit 15b44ada0dc remove useless code
omit 94e7c1d64a9 fix compilation problem
omit 58220e0a0f4 fix bug
omit 0c17c075a04 enable wal compression
add d9207b9a0e7 Update properties (#12625)
add 6ebaa435963 Generate compaction target file with tier level (#12597)
add fe35c8f6d42 Make UDTF execution framework batch processing (#12562)
add f460ef89032 Support special path for device TTL
add 4ff9c8373fe Revert auto create STRING type inference
add 52affcff02f load-tsfile script: optimization for loading tsfiles in
dir and error handling (#12541)
add 9d9f9460b4a Procedure: Fix thread-unsafe between procedure enqueue and
dequeue (#12629)
add db268afc910 Add datatype check for restapi insertRecords and fix query
bug (#12631)
add d83632d2cd4 fix scripts after merge config file (#12628)
add 7a2419ce1f1 Fix compaction metric and read device MetadataIndexNode
add 9000bad2a65 PipeConsensus: complete consensus prodedure and pipe
components with new thrift service (#12355)
add f28f1fd3787 JDBC: Support different charsets (#12632)
add 3d3fd86b16c [IOTDB-6325] Support RegionScan for active metadata
queries [BE Part Two]
add 8a6e31ffe5a add import-schema.sh/bat and export-schema.sh/bat in
cli/tools (#12623)
add 78660628e75 load-tsfile script:Addition of statistical information
(#12634)
add 7310a50c30a load-tsfile script: remove unnecessary logs (#12635)
add 76a8d6ca12a Change schema_region_total_device_cnt label to
SCHEMA_ENGINE (#12636)
add 28cd29c930e Remove unknown and vector in udf-api Type
add 371e3f6660b [IOTDB-6336] Add max retry time duration and whether to
retry for unknown errors configurations
add ec4fc5b6b00 Optimize error message when creating unsupported data type
(#12650)
add 3cf91fda840 Pipe: fix uninitialized config when validate
PipeHistoricalDataRegionTsFileExtractor parameters & Subscription: avoid poll
messages from unsubscribed topics (#12648)
add c9efe09e706 Fix region migration's timeout judgement #12639
add b0f16584a6e fix compaction recover skip negative time partition
(#12637)
add cf0d3dd93e3 Fix Concurrency Instability When IoTConsensus
LogDispatcher Exits #12655
add d0f17446687 JDBC: Fix IndexOutOfBoundsException when calling getBytes
(#12662)
add 5b26dfa620b [IOTDB-6335] Redundant rows when using GROUP BY TIME with
LIMIT
add 4de7e691116 Pipe: Enhance error handling logic in pipe async
connector's handlers (#12669)
add d78413ec657 Print log when read resource error (#12666)
add a60b181a354 Load: Make load SQL option VERIFY can only be set to true
(#12670)
add 6639d5742b7 Pipe: Improved hybrid algorithm and avoid the caculations
of tsfiles in connector pending queue tsfiles to block the forwarding of
realtime requests (#12668)
add a0832455944 Migrate to Develocity Maven Extension (#12658)
add 2e433b5ec95 Update import schema logic implementation and optimize
-help display information (#12643)
add 351ab3075ba Subscription: fix topic now timestamp precision (#12663)
add 4c6e110e28f [IOTDB-6337] Refine the count calculation in RegionScan
framework
add baa9e5dd86a Bump version of master branch to 1.3.3-SNAPSHOT (#12672)
add 0073a3d3bf2 Pipe: Reduce warn log when
PipeConfigRegionExtractorMetrics does not exist (#12673)
add e2c705aa898 [IOTDB-6061] Fix the instability failure caused by
initServer in IoTConsensus UT not binding to the corresponding port (#12674)
add 036d73679c2 Load: Make load SQL option VERIFY can only be set to true
(A follow-up fix for #12670) (#12676)
add 223f95cde8c Pipe: add compression level config for connector ZSTD
compressor (#12630)
add 849c09fae2e [PY-client] Unify setup.py and requirement.txt (#12601)
add 82f203e4039 Pipe IT: Ignore failed cases caused by cluster restart
failure (#12678)
add 18d7f0ba6b0 update import and export data -help description (#12677)
add 46daebab423 Pipe: Fix potential NPE when lastEvent == null in
PipeConnectorSubtask (#12680)
add 2d04d22d5fe Fix wrong calculation for maxBytesCanReserve for
IdentitySinkOperator
add c441c3af8e2 Change floating point encoding method in IT
add 9340708c4f8 Throw `IndexOutOfBound` exception in row implementation.
add 6a2bec2bde2 Thread safely SeriesPartitionTable (#12679)
add 50d1c050563 Pipe: Refactor some features for user access (#12686)
add 42e76346c3e Set timestamp precision same as time column (#12681)
add 7ab58fd4929 Set configuration on node (#12626)
add 38465631d49 Fix cli report error when ignoreTimestamp is true (#12691)
add c2f3640431a Load: Add check for BufferUnderflowException (#12690)
add a64dc4c530d remove excess stack
add 070c5e3ada8 Fix new UDTF execution framework dead loop error.
add ab9347bfde9 Perfect methods of IAnalysis to adapt the write process of
table model
add 724f2adc729 Load: Support storing piecenode in multiple folders during
2nd phase (#12675)
add 278da484343 Pipe: add decompressed length in RPC compression payload
to avoid potential OOM on receiver (#12701)
add b18ccf3b03c Load: Update loadTsFileDirs after all newLoadTsFileDirs
are generated to avoid undefined behavior (#12712)
add e887ea00523 Pipe: Fixed NPE in schema pattern parsing & Improved
connector subtask retry logic and logs & Fixed the executor used by consensus
pipe (#12704)
add ed3b4b73cf4 Procedure: Fix ProcedureInfo on CN leader may decrease its
procId (#12711)
add a178a79a33f Fix missing of linux memory metrics (#12713)
add a9d14018812 update import and export tsfile description (#12684)
add 20c4cd25a3e Subscription: skip on setup and cluster failure when
running subscription restart IT & fix some bugs in
SubscriptionExecutorServiceManager (#12710)
add 3ae990b8524 Update pom.xml to fix security issue (#12705)
add 24a53761d8f Rename IoTV2Consensus to IoTConsensusV2 (#12715)
add fecdca5be17 Fix NumberFormatException when upgrade from old version
#12719
add bd3094265bb Replenish effective mode in iotdb-system.properties
(#12706)
add c10c95f25d8 load-tsfile script: disable redirection & load: handle
exceptions using the Analysis objects instead of throwing exceptions & pipe:
handle SYSTEM_READ_ONLY correctly on receiver side (#12716)
add dcdbbe524e9 Subscription: improve parsing logic when using JAVA SDK
client & refactor subscription IT & intro `getSubscribedTopicNames` API (#12721)
add 0a3ca29e6a3 Pipe: Fix schema events can not report & Fix delete data
events in data regions may fail to mark at schema metrics (#12722)
add cf4aed79c5d Pipe: Support `"source.history.loose-range" = "path"` in
iotdb-source (#12651)
add 273d4839a44 [IOTDB-6338] Fix wrong query result while using some value
filter with LIMIT/OFFSET
add db051377ef5 Pipe: fix threads of IoTDB-Pipe-Processor-Executor-Pool
stucked by PipeTsFileInsertionEvent#waitForTsFileClose (#12727)
add fb8f2fb09da [ISSUE 12499] Reject query with massive time span in
limited memroy
add a42e6443170 Fix/include thrift lib and headers in cpp client (#12734)
add 0dbb3891b27 Pipe / Load / Subscription: Support new TsDataTypes
(STRING / BLOB / TIMESTAMP / DATE) (#12665)
add 7b993f4b82c Optimize the log printing when multiple error occur
(#12732)
add ece53539522 Update packege hierachy in Client-cpp readme (#12736)
add c5d7999c9c5 Support agg(*) query in templated align by device situation
add c02471e7039 fix config node use IoTDBDescriptor (#12730)
add b3aae802ac8 PipeConsensus: Delete WAL after dropping database & fix
receiver directory recovery (#12738)
add 599bc864251 Add instructions of compiling client-cpp with VS2019.
(#12739)
add 93211e10489 Subscription: adapt pipe completion signal for
automatically drop subscription (#12724)
add 85971c66593 Verify connection && Refactor async connection framework
(#12667)
add 3168bf68870 PipeConsensus: add metrics and fix some bugs for
pipeConsensus (#12723)
add 9c085d13af2 Decrease TTL Deletion in compaction modification cache
(#12687)
add 74212dbae2d Stabilize verify connection IT (#12745)
add d3f605fa8f3 Fix compaction npe when set modified status (#12729)
add d00c7665baa Subscription IT: execute jstack for potential stuck test
cases (#12728)
add 89af73d2088 Pipe: Smoothed the rate in pipe's remaining time
calculations (#12699)
add 8c52f5c5408 enable wal compression
add 693ffb781de fix bug
add e2e6bc11f6e fix compilation problem
add 896a357df3a remove useless code
add ee3a64f720c recover some code
add 1316653b5bf support compression type in WAL Compress Header
add 2728057d9c1 support multi version WAL
add e70df23c5ac edit configuration item
add 2db27b14f67 add log for WAL size
add b505d31e4c3 temp for debug
add 95c0fd5ed19 fix bug
add 23d17437729 remove useless log
add 8bedc72c3ed remove one configuration
add 69ebc898dd2 use compression rate to update wal disk usage
add d6ca95b5cc3 fix ut
add 4373559a136 fix test
add 27a15c34454 set default to uncompress
add cd8939fba7c fix wal ut
add 610a2e2fbe5 optimize calculating of wal size
add 8929d419f75 close wal file when the origin size of wal buffer is
larger than threshold
add b2d667ffa4e add the size of magic string
add 3297ffb9f0f may be fix the bug
add b3653476b50 fix with comment
add 443d1a095cb edit with review
add 130930e9708 fix test
add ad021a7eb5e add test for wal compression
add 964bf9b657b add hot reload
add 0f17197a6ff clean the code to make it more readable
add e48b7dba432 reuse the byte buffer if possible
add 76cc1390596 Indicate the encoding of String
add 581481245f1 Edit according to comment
add d0b76f33de4 spotless
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (ee767637a94)
\
N -- N -- N refs/heads/wal-compress-formal-branch (d0b76f33de4)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.github/workflows/cluster-it-1c1d.yml | 2 +-
.github/workflows/cluster-it-1c3d.yml | 2 +-
.github/workflows/pipe-it-2cluster.yml | 2 +-
.github/workflows/sonar-codecov.yml | 2 +-
.github/workflows/unit-test.yml | 2 +-
.gitignore | 1 +
.mvn/{gradle-enterprise.xml => develocity.xml} | 15 +-
.mvn/extensions.xml | 6 +-
code-coverage/pom.xml | 2 +-
distribution/pom.xml | 10 +-
distribution/src/assembly/all.xml | 9 +
distribution/src/assembly/confignode.xml | 9 +
distribution/src/assembly/datanode.xml | 9 +
example/client-cpp-example/pom.xml | 2 +-
example/jdbc/pom.xml | 2 +-
.../java/org/apache/iotdb/JDBCCharsetExample.java | 99 ++
example/mqtt-customize/pom.xml | 2 +-
example/mqtt/pom.xml | 2 +-
example/pipe-count-point-processor/pom.xml | 2 +-
.../java/org/apache/iotdb/CountPointProcessor.java | 14 +-
example/pipe-opc-ua-sink/pom.xml | 2 +-
example/pom.xml | 2 +-
example/rest-java-example/pom.xml | 2 +-
example/schema/pom.xml | 3 +-
example/session/pom.xml | 2 +-
.../apache/iotdb/SubscriptionSessionExample.java | 154 ++-
example/trigger/pom.xml | 2 +-
example/udf/pom.xml | 2 +-
integration-test/pom.xml | 32 +-
.../iotdb/it/env/cluster/ClusterConstant.java | 3 +
.../org/apache/iotdb/it/env/cluster/EnvUtils.java | 18 +
.../it/env/cluster/config/MppCommonConfig.java | 26 +
.../env/cluster/config/MppSharedCommonConfig.java | 25 +
.../iotdb/it/env/cluster/env/AbstractEnv.java | 4 +-
.../it/env/cluster/node/AbstractNodeWrapper.java | 73 +-
.../it/env/remote/config/RemoteCommonConfig.java | 17 +
.../org/apache/iotdb/it/utils/TsFileGenerator.java | 103 +-
.../apache/iotdb/itbase/env/BaseNodeWrapper.java | 16 +-
.../org/apache/iotdb/itbase/env/CommonConfig.java | 7 +
.../iotdb/itbase/runtime/RequestDelegate.java | 10 +-
...TDBLoadTsFileIT.java => IoTDBLoadTsFileIT.java} | 394 ++++--
.../org/apache/iotdb/db/it/IoTDBRepairDataIT.java | 5 +-
.../iotdb/db/it/IoTDBSetConfigurationIT.java | 89 ++
.../java/org/apache/iotdb/db/it/IoTDBSettleIT.java | 2 +-
.../org/apache/iotdb/db/it/IoTDBSimpleQueryIT.java | 5 +-
.../iotdb/db/it/IoTDBVerifyConnectionIT.java | 115 ++
.../db/it/aggregation/IoTDBAggregationIT.java | 15 +-
.../db/it/aggregation/maxby/IoTDBMaxByIT.java | 3 +-
.../db/it/aggregation/minby/IoTDBMinByIT.java | 3 +-
...oTDBAlignByDeviceWithTemplateAggregationIT.java | 130 +-
.../db/it/aligned/IoTDBPredicatePushDownIT.java | 27 +
.../db/it/orderBy/IoTDBOrderByForDebugIT.java | 1406 ++++++++++++++++++++
.../db/it/regionscan/IoTDBActiveRegionScanIT.java | 501 +++++++
.../db/it/regionscan/IoTDBActiveRegionScanIT2.java | 52 +
.../IoTDBActiveRegionScanWithModsIT.java | 188 +++
.../IoTDBActiveRegionScanWithModsIT2.java | 52 +
.../db/it/schema/IoTDBAutoCreateSchemaIT.java | 16 +-
.../db/it/schema/IoTDBCreateTimeseriesIT.java | 31 +
.../iotdb/db/it/selectinto/IoTDBSelectIntoIT.java | 2 +-
.../iotdb/db/it/udaf/IoTDBUDAFOrderByIT.java | 5 +-
.../iotdb/db/it/udf/IoTDBUDFWindowQuery2IT.java | 216 +++
.../db/it/udf/IoTDBUDTFBuiltinFunctionIT.java | 4 +-
.../it/autocreate/IoTDBPipeAutoConflictIT.java | 42 +-
.../pipe/it/autocreate/IoTDBPipeAutoDropIT.java | 62 +-
.../pipe/it/autocreate/IoTDBPipeClusterIT.java | 44 +-
.../IoTDBPipeConnectorCompressionIT.java | 126 ++
.../pipe/it/autocreate/IoTDBPipeDataSinkIT.java | 105 ++
.../pipe/it/autocreate/IoTDBPipeExtractorIT.java | 97 ++
.../pipe/it/autocreate/IoTDBPipeLifeCycleIT.java | 31 +-
.../it/manual/IoTDBPipeMetaLeaderChangeIT.java | 2 +-
.../pipe/it/manual/IoTDBPipeMetaRestartIT.java | 18 +-
.../iotdb/pipe/it/single/IoTDBPipeAggregateIT.java | 14 +
.../iotdb/session/it/IoTDBSessionSimpleIT.java | 2 +-
.../subscription/it/AbstractSubscriptionIT.java | 49 +
.../it/IoTDBSubscriptionITConstant.java | 19 +-
.../iotdb/subscription/it/SkipOnSetUpFailure.java | 82 ++
.../IoTDBSubscriptionRestartIT.java | 115 +-
.../it/dual/AbstractSubscriptionDualIT.java | 24 +-
.../it/dual/IoTDBSubscriptionConsumerGroupIT.java | 49 +-
.../it/dual/IoTDBSubscriptionTimePrecisionIT.java | 190 +++
.../it/dual/IoTDBSubscriptionTopicIT.java | 256 ++--
.../it/local/AbstractSubscriptionLocalIT.java | 25 +-
.../it/local/IoTDBSubscriptionBasicIT.java | 300 +++--
.../it/local/IoTDBSubscriptionIdempotentIT.java | 14 +-
.../apache/iotdb/tools/it/ExportDataTestIT.java | 12 +-
...portDataTestIT.java => ExportSchemaTestIT.java} | 74 +-
.../apache/iotdb/tools/it/ExportTsFileTestIT.java | 8 +-
.../apache/iotdb/tools/it/ImportDataTestIT.java | 16 +-
...portDataTestIT.java => ImportSchemaTestIT.java} | 31 +-
iotdb-api/external-api/pom.xml | 2 +-
iotdb-api/pipe-api/pom.xml | 2 +-
.../java/org/apache/iotdb/pipe/api/access/Row.java | 46 +-
.../java/org/apache/iotdb/pipe/api/type/Type.java | 15 +-
iotdb-api/pom.xml | 2 +-
iotdb-api/trigger-api/pom.xml | 2 +-
iotdb-api/udf-api/pom.xml | 2 +-
.../main/java/org/apache/iotdb/udf/api/UDTF.java | 5 +
.../java/org/apache/iotdb/udf/api/access/Row.java | 2 +-
.../java/org/apache/iotdb/udf/api/type/Type.java | 7 +-
.../org/apache/iotdb/udf/api/utils/RowImpl.java | 33 +-
iotdb-client/cli/pom.xml | 18 +-
.../cli/src/assembly/resources/tools/backup.bat | 7 +-
.../tools/{load-tsfile.bat => export-schema.bat} | 67 +-
.../src/assembly/resources/tools/export-schema.sh | 57 +
.../tools/{load-tsfile.bat => import-schema.bat} | 66 +-
.../src/assembly/resources/tools/import-schema.sh | 57 +
.../src/assembly/resources/tools/load-tsfile.bat | 67 +-
.../src/assembly/resources/tools/load-tsfile.sh | 80 +-
.../java/org/apache/iotdb/cli/AbstractCli.java | 34 +-
.../org/apache/iotdb/tool/AbstractDataTool.java | 33 +-
...stractDataTool.java => AbstractSchemaTool.java} | 149 +--
.../org/apache/iotdb/tool/AbstractTsFileTool.java | 63 +-
.../java/org/apache/iotdb/tool/ExportData.java | 14 +-
.../java/org/apache/iotdb/tool/ExportSchema.java | 339 +++++
.../java/org/apache/iotdb/tool/ExportTsFile.java | 21 +-
.../java/org/apache/iotdb/tool/ImportData.java | 8 +-
.../java/org/apache/iotdb/tool/ImportSchema.java | 645 +++++++++
.../java/org/apache/iotdb/tool/ImportTsFile.java | 556 ++++++++
iotdb-client/client-cpp/README.md | 86 +-
iotdb-client/client-cpp/pom.xml | 4 +-
.../client-cpp/src/assembly/client-cpp.xml | 12 +-
iotdb-client/client-py/pom.xml | 4 +-
iotdb-client/client-py/requirements.txt | 4 +-
iotdb-client/client-py/resources/setup.py | 7 +-
iotdb-client/isession/pom.xml | 8 +-
iotdb-client/jdbc/pom.xml | 8 +-
.../main/java/org/apache/iotdb/jdbc/Config.java | 3 +
.../org/apache/iotdb/jdbc/IoTDBConnection.java | 10 +-
.../apache/iotdb/jdbc/IoTDBConnectionParams.java | 12 +
.../org/apache/iotdb/jdbc/IoTDBJDBCResultSet.java | 76 +-
.../apache/iotdb/jdbc/IoTDBPreparedStatement.java | 16 +-
.../java/org/apache/iotdb/jdbc/IoTDBStatement.java | 91 +-
.../src/main/java/org/apache/iotdb/jdbc/Utils.java | 16 +-
.../org/apache/iotdb/jdbc/IoTDBStatementTest.java | 8 +-
iotdb-client/pom.xml | 2 +-
iotdb-client/service-rpc/pom.xml | 6 +-
.../org/apache/iotdb/rpc/IoTDBJDBCDataSet.java | 4 +-
.../java/org/apache/iotdb/rpc/IoTDBRpcDataSet.java | 18 +-
.../main/java/org/apache/iotdb/rpc/RpcUtils.java | 20 +-
.../java/org/apache/iotdb/rpc/TSStatusCode.java | 9 +
.../iotdb/rpc/subscription/config/TopicConfig.java | 32 +-
.../rpc/subscription/config/TopicConstant.java | 5 +
.../SubscriptionIdentifierSemanticException.java | 29 +-
.../payload/poll/SubscriptionPollResponse.java | 3 +
.../payload/poll/SubscriptionPollResponseType.java | 2 +
.../payload/poll/TerminationPayload.java | 38 +-
.../response/PipeSubscribeSubscribeResp.java | 51 +-
.../response/PipeSubscribeUnsubscribeResp.java | 51 +-
iotdb-client/session/pom.xml | 10 +-
.../consumer/SubscriptionConsumer.java | 116 +-
.../SubscriptionExecutorServiceManager.java | 8 +-
.../consumer/SubscriptionProvider.java | 12 +-
.../consumer/SubscriptionPullConsumer.java | 9 +-
.../consumer/SubscriptionPushConsumer.java | 8 +-
.../payload/SubscriptionFileHandler.java | 20 +-
.../payload/SubscriptionSessionDataSet.java | 9 +-
.../session/subscription/util/IdentifierUtils.java | 51 +
iotdb-core/antlr/pom.xml | 2 +-
.../org/apache/iotdb/db/qp/sql/IdentifierParser.g4 | 1 +
.../org/apache/iotdb/db/qp/sql/IoTDBSqlParser.g4 | 17 +-
.../antlr4/org/apache/iotdb/db/qp/sql/SqlLexer.g4 | 4 +
iotdb-core/confignode/pom.xml | 24 +-
.../assembly/resources/sbin/stop-confignode.bat | 19 +-
...RequestType.java => CnToCnNodeRequestType.java} | 8 +-
...NodeRequestType.java => CnToDnRequestType.java} | 7 +-
.../async/AsyncConfigNodeHeartbeatClientPool.java | 7 +-
.../client/async/AsyncDataNodeClientPool.java | 545 --------
.../CnToCnInternalServiceAsyncRequestManager.java | 74 ++
.../CnToDnInternalServiceAsyncRequestManager.java | 376 ++++++
.../handlers/ConfigNodeAsyncRequestContext.java} | 27 +-
.../handlers/DataNodeAsyncRequestContext.java | 50 +
.../rpc/CheckTimeSeriesExistenceRPCHandler.java | 22 +-
.../rpc/ConfigNodeAsyncRequestRPCHandler.java | 88 ++
...dler.java => ConfigNodeTSStatusRPCHandler.java} | 32 +-
.../rpc/CountPathsUsingTemplateRPCHandler.java | 22 +-
.../DataNodeAsyncRequestRPCHandler.java} | 175 +--
...andler.java => DataNodeTSStatusRPCHandler.java} | 12 +-
.../rpc/FetchSchemaBlackListRPCHandler.java | 20 +-
.../handlers/rpc/PipeHeartbeatRPCHandler.java | 8 +-
.../async/handlers/rpc/PipePushMetaRPCHandler.java | 8 +-
.../async/handlers/rpc/SchemaUpdateRPCHandler.java | 14 +-
...ava => SubmitTestConnectionTaskRPCHandler.java} | 42 +-
...itTestConnectionTaskToConfigNodeRPCHandler.java | 74 ++
.../handlers/rpc/TransferLeaderRPCHandler.java | 9 +-
.../CheckSchemaRegionUsingTemplateRPCHandler.java | 27 +-
.../ConsumerGroupPushMetaRPCHandler.java | 10 +-
.../rpc/subscription/TopicPushMetaRPCHandler.java | 10 +-
.../client/sync/SyncConfigNodeClientPool.java | 13 +-
.../client/sync/SyncDataNodeClientPool.java | 17 +-
.../iotdb/confignode/conf/ConfigNodeConfig.java | 49 +-
.../confignode/conf/ConfigNodeDescriptor.java | 29 +-
.../confignode/conf/ConfigNodeRemoveCheck.java | 4 +-
.../confignode/conf/ConfigNodeStartupCheck.java | 12 +
.../iotdb/confignode/manager/ClusterManager.java | 221 +++
.../confignode/manager/ClusterQuotaManager.java | 23 +-
.../iotdb/confignode/manager/ConfigManager.java | 52 +
.../apache/iotdb/confignode/manager/IManager.java | 8 +
.../iotdb/confignode/manager/TTLManager.java | 7 +-
.../iotdb/confignode/manager/TriggerManager.java | 14 +-
.../iotdb/confignode/manager/UDFManager.java | 20 +-
.../confignode/manager/cq/CQScheduleTask.java | 5 +-
.../manager/load/balancer/RouteBalancer.java | 31 +-
.../iotdb/confignode/manager/node/NodeManager.java | 167 ++-
.../manager/partition/PartitionManager.java | 41 +-
.../pipe/agent/task/PipeConfigNodeTaskAgent.java | 10 +
.../runtime/heartbeat/PipeHeartbeatScheduler.java | 15 +-
.../pipe/event/PipeConfigRegionSnapshotEvent.java | 13 +-
.../pipe/event/PipeConfigRegionWritePlanEvent.java | 8 +-
.../execution/PipeConfigNodeSubtaskExecutor.java | 6 +-
.../metric/PipeConfigNodeRemainingTimeMetrics.java | 34 +-
.../PipeConfigNodeRemainingTimeOperator.java | 99 +-
.../metric/PipeConfigRegionExtractorMetrics.java | 4 +-
.../manager/pipe/task/PipeConfigNodeTaskStage.java | 16 +-
.../manager/schema/ClusterSchemaManager.java | 14 +-
.../confignode/persistence/ProcedureInfo.java | 2 +-
.../persistence/pipe/PipePluginInfo.java | 39 +-
.../confignode/persistence/pipe/PipeTaskInfo.java | 5 +
.../procedure/env/ConfigNodeProcedureEnv.java | 237 ++--
.../procedure/env/RegionMaintainHandler.java | 90 +-
.../impl/pipe/task/CreatePipeProcedureV2.java | 79 +-
.../impl/schema/AlterLogicalViewProcedure.java | 18 +-
.../impl/schema/DataNodeRegionTaskExecutor.java | 25 +-
.../impl/schema/DeactivateTemplateProcedure.java | 27 +-
.../impl/schema/DeleteDatabaseProcedure.java | 16 +-
.../impl/schema/DeleteLogicalViewProcedure.java | 22 +-
.../impl/schema/DeleteTimeSeriesProcedure.java | 26 +-
.../procedure/impl/schema/SchemaUtils.java | 6 +-
.../procedure/impl/schema/SetTTLProcedure.java | 14 +-
.../impl/schema/SetTemplateProcedure.java | 30 +-
.../impl/schema/UnsetTemplateProcedure.java | 22 +-
.../subscription/CreateSubscriptionProcedure.java | 2 +
.../subscription/DropSubscriptionProcedure.java | 151 ++-
.../subscription/topic/CreateTopicProcedure.java | 6 +-
.../impl/sync/AuthOperationProcedure.java | 13 +-
.../scheduler/SimpleProcedureScheduler.java | 7 +-
.../iotdb/confignode/service/ConfigNode.java | 8 +-
.../confignode/service/ConfigNodeShutdownHook.java | 4 +-
.../thrift/ConfigNodeRPCServiceProcessor.java | 33 +
iotdb-core/consensus/pom.xml | 21 +-
.../apache/iotdb/consensus/ConsensusFactory.java | 25 +
.../iotdb/consensus/config/ConsensusConfig.java | 19 +-
.../consensus/config/PipeConsensusConfig.java | 358 +++++
.../apache/iotdb/consensus/iot/IoTConsensus.java | 1 +
.../iot/client/AsyncIoTConsensusServiceClient.java | 2 +-
.../consensus/iot/logdispatcher/LogDispatcher.java | 34 +-
.../apache/iotdb/consensus/pipe/PipeConsensus.java | 465 +++++++
.../consensus/pipe/PipeConsensusPeerManager.java | 154 +++
.../consensus/pipe/PipeConsensusServerImpl.java | 594 +++++++++
.../consensuspipe/ConsensusPipeConnector.java} | 14 +-
.../consensuspipe/ConsensusPipeDispatcher.java} | 36 +-
.../pipe/consensuspipe/ConsensusPipeGuardian.java} | 15 +-
.../pipe/consensuspipe/ConsensusPipeManager.java | 110 ++
.../pipe/consensuspipe/ConsensusPipeName.java | 98 ++
.../pipe/consensuspipe/ConsensusPipeReceiver.java} | 16 +-
.../pipe/consensuspipe/ConsensusPipeSelector.java} | 17 +-
.../pipe/consensuspipe/ProgressIndexManager.java | 15 +-
.../pipe/metric/PipeConsensusServerMetrics.java | 190 +++
.../pipe/metric/PipeConsensusSyncLagManager.java | 131 ++
.../pipe/service/PipeConsensusRPCService.java | 97 ++
.../service/PipeConsensusRPCServiceHandler.java} | 37 +-
.../service/PipeConsensusRPCServiceMBean.java} | 13 +-
.../service/PipeConsensusRPCServiceProcessor.java | 210 +++
.../apache/iotdb/consensus/iot/ReplicateTest.java | 111 +-
iotdb-core/datanode/pom.xml | 39 +-
.../src/assembly/resources/sbin/stop-datanode.bat | 24 +-
.../org/apache/iotdb/db/audit/AuditLogger.java | 1 +
.../org/apache/iotdb/db/auth/AuthorityChecker.java | 32 +-
.../java/org/apache/iotdb/db/conf/IoTDBConfig.java | 118 +-
.../org/apache/iotdb/db/conf/IoTDBDescriptor.java | 115 +-
.../db/consensus/DataRegionConsensusImpl.java | 38 +
.../metadata/DataTypeMismatchException.java | 13 +
.../PipeDataRegionConnectorConstructor.java | 7 +
.../PipeDataRegionProcessorConstructor.java | 4 +
.../agent/receiver/PipeDataNodeReceiverAgent.java | 13 +
.../agent/runtime/PipeDataNodeRuntimeAgent.java | 32 +-
.../db/pipe/agent/task/PipeDataNodeTaskAgent.java | 79 +-
.../request/PipeTransferTabletRawReq.java | 70 +-
.../connector/protocol/opcua/OpcUaConnector.java | 14 +
.../pipeconsensus/PipeConsensusAsyncConnector.java | 593 +++++++++
.../pipeconsensus/PipeConsensusSyncConnector.java | 456 +++++++
.../PipeConsensusTabletBatchEventHandler.java | 133 ++
.../PipeConsensusTabletInsertNodeEventHandler.java | 47 +
.../PipeConsensusTabletInsertionEventHandler.java} | 66 +-
.../PipeConsensusTsFileInsertionEventHandler.java} | 185 +--
.../PipeConsensusAsyncBatchReqBuilder.java} | 18 +-
.../builder/PipeConsensusSyncBatchReqBuilder.java | 45 +
.../PipeConsensusTransferBatchReqBuilder.java | 218 +++
.../request/PipeConsensusTabletBatchReq.java | 83 ++
.../request/PipeConsensusTabletBinaryReq.java | 126 ++
.../request/PipeConsensusTabletInsertNodeReq.java | 154 +++
.../request/PipeConsensusTsFilePieceReq.java | 79 ++
.../PipeConsensusTsFilePieceWithModReq.java | 80 ++
.../request/PipeConsensusTsFileSealReq.java | 74 ++
.../request/PipeConsensusTsFileSealWithModReq.java | 85 ++
.../PipeTransferTabletBatchEventHandler.java | 28 +-
.../PipeTransferTabletInsertionEventHandler.java | 22 +-
.../PipeTransferTsFileInsertionEventHandler.java | 18 +-
.../consensus/ConsensusPipeDataNodeDispatcher.java | 121 ++
.../ConsensusPipeDataNodeRuntimeAgentGuardian.java | 48 +
.../consensus/PipeConsensusConnectorMetrics.java | 290 ++++
.../consensus/PipeConsensusReceiverMetrics.java | 384 ++++++
.../PipeConsensusSubtaskExecutor.java} | 11 +-
.../consensus/ProgressIndexDataNodeManager.java | 128 ++
.../db/pipe/event/UserDefinedEnrichedEvent.java | 23 +-
.../event/common/heartbeat/PipeHeartbeatEvent.java | 61 +-
.../event/common/row/PipeDataTypeTransformer.java | 14 +-
.../iotdb/db/pipe/event/common/row/PipeRow.java | 53 +-
.../db/pipe/event/common/row/PipeRowCollector.java | 1 +
.../schema/PipeSchemaRegionSnapshotEvent.java | 14 +-
.../schema/PipeSchemaRegionWritePlanEvent.java | 8 +-
.../tablet/PipeInsertNodeTabletInsertionEvent.java | 66 +-
.../common/tablet/PipeRawTabletInsertionEvent.java | 75 +-
.../tablet/TabletInsertionDataContainer.java | 99 +-
.../event/common/terminate/PipeTerminateEvent.java | 10 +-
.../common/tsfile/PipeTsFileInsertionEvent.java | 64 +-
.../tsfile/TsFileInsertionDataContainer.java | 2 +
.../db/pipe/event/realtime/PipeRealtimeEvent.java | 11 +-
.../execution/PipeConnectorSubtaskExecutor.java | 7 +-
.../execution/PipeProcessorSubtaskExecutor.java | 3 +-
.../pipe/execution/PipeSubtaskExecutorManager.java | 7 +
.../PipeHistoricalDataRegionTsFileExtractor.java | 170 ++-
.../realtime/PipeRealtimeDataRegionExtractor.java | 18 +-
.../PipeRealtimeDataRegionHybridExtractor.java | 9 +-
.../realtime/assigner/PipeDataRegionAssigner.java | 2 +-
.../PipeDataNodeRemainingEventAndTimeMetrics.java | 46 +-
.../PipeDataNodeRemainingEventAndTimeOperator.java | 161 ++-
.../processor/aggregate/AggregateProcessor.java | 43 +-
.../aggregate/TimeSeriesRuntimeState.java | 94 ++
.../CustomizedReadableIntermediateResults.java | 49 +-
.../IntermediateResultOperator.java | 41 +-
.../numeric/AbstractSameTypeNumericOperator.java | 46 +-
.../doubletype/FractionPoweredSumOperator.java | 56 +-
.../specifictype/integertype/CountOperator.java | 54 +-
.../window/datastructure/TimeSeriesWindow.java | 111 ++
.../AbstractSimpleTimeWindowingProcessor.java | 52 +-
.../processor/AbstractWindowingProcessor.java | 45 +-
.../downsampling/changing/ChangingValueFilter.java | 22 +-
.../sdt/SwingingDoorTrendingFilter.java | 20 +-
.../pipeconsensus/PipeConsensusProcessor.java | 103 ++
.../twostage/plugin/TwoStageCountProcessor.java | 2 +-
...igner.java => SimpleProgressIndexAssigner.java} | 11 +-
.../pipeconsensus/PipeConsensusReceiver.java | 1396 +++++++++++++++++++
.../pipeconsensus/PipeConsensusReceiverAgent.java | 169 +++
.../visitor/PipeStatementExceptionVisitor.java | 2 +-
.../visitor/PipeStatementTSStatusVisitor.java | 21 +-
.../resource/tsfile/PipeTsFileResourceManager.java | 38 +-
.../pipe/task/builder/PipeDataNodeTaskBuilder.java | 4 +-
.../pipe/task/connection/PipeEventCollector.java | 14 +-
.../subtask/connector/PipeConnectorSubtask.java | 10 +-
.../subtask/processor/PipeProcessorSubtask.java | 7 +-
.../iotdb/db/protocol/client/ConfigNodeClient.java | 43 +-
.../cn/AsyncConfigNodeTSStatusRPCHandler.java} | 34 +-
.../cn/ConfigNodeAsyncRequestRPCHandler.java | 79 ++
.../DnToCnInternalServiceAsyncRequestManager.java | 64 +
.../db/protocol/client/cn/DnToCnRequestType.java} | 15 +-
.../client/dn}/AsyncTSStatusRPCHandler.java | 9 +-
.../client/dn/DataNodeAsyncRequestRPCHandler.java | 84 ++
...DataNodeExternalServiceAsyncRequestManager.java | 83 ++
.../dn/DataNodeMPPServiceAsyncRequestManager.java | 84 ++
.../DnToDnInternalServiceAsyncRequestManager.java | 64 +
.../db/protocol/client/dn/DnToDnRequestType.java} | 14 +-
.../db/protocol/rest/utils/InsertRowDataUtils.java | 20 +-
.../v2/handler/StatementConstructionHandler.java | 27 +-
.../protocol/thrift/impl/ClientRPCServiceImpl.java | 76 +-
.../impl/DataNodeInternalRPCServiceImpl.java | 130 +-
.../queryengine/common/TimeseriesSchemaInfo.java | 54 +-
.../common/header/ColumnHeaderConstant.java | 11 +
.../common/header/DatasetHeaderFactory.java | 4 +
.../execution/driver/DataDriverContext.java | 30 +
.../execution/exchange/MPPDataExchangeManager.java | 7 +
.../fragment/FragmentInstanceContext.java | 12 +-
.../execution/load/AlignedChunkData.java | 124 +-
.../execution/load/LoadTsFileManager.java | 138 +-
.../execution/load/NonAlignedChunkData.java | 65 +-
.../process/ActiveRegionScanMergeOperator.java | 299 +++++
.../operator/process/TransformOperator.java | 127 +-
.../operator/schema/source/DeviceSchemaSource.java | 2 +-
.../AbstractRegionScanDataSourceOperator.java | 156 +++
.../AbstractRegionScanForActiveDataUtil.java | 199 +++
.../source/ActiveDeviceRegionScanOperator.java | 114 ++
.../source/ActiveTimeSeriesRegionScanOperator.java | 167 +++
.../source/RegionScanForActiveDeviceUtil.java | 173 +++
.../source/RegionScanForActiveTimeSeriesUtil.java | 172 +++
.../execution/operator/source/SeriesScanUtil.java | 3 +-
.../queryengine/load/LoadTsFileMemoryManager.java | 10 +-
.../db/queryengine/plan/analyze/Analysis.java | 11 +
.../queryengine/plan/analyze/AnalyzeVisitor.java | 71 +-
.../db/queryengine/plan/analyze/IAnalysis.java | 16 +
.../plan/analyze/LoadTsfileAnalyzer.java | 40 +-
.../plan/analyze/TemplatedAggregationAnalyze.java | 58 +-
.../queryengine/plan/analyze/TemplatedAnalyze.java | 11 +-
.../analyze/cache/schema/DataNodeTTLCache.java | 38 +-
.../plan/execution/config/ConfigTaskVisitor.java | 16 +
.../config/executor/ClusterConfigTaskExecutor.java | 118 +-
.../config/executor/IConfigTaskExecutor.java | 5 +
.../execution/config/sys/SetConfigurationTask.java | 45 +
.../execution/config/sys/TestConnectionTask.java | 218 +++
.../plan/expression/multi/FunctionExpression.java | 8 +
.../multi/builtin/BuiltInScalarFunctionHelper.java | 6 +-
.../multi/builtin/helper/CastFunctionHelper.java | 6 +-
.../multi/builtin/helper/DiffFunctionHelper.java | 6 +-
.../builtin/helper/ReplaceFunctionHelper.java | 6 +-
.../multi/builtin/helper/RoundFunctionHelper.java | 6 +-
.../builtin/helper/SubStringFunctionHelper.java | 6 +-
.../visitor/IntermediateLayerVisitor.java | 146 +-
.../plan/optimization/LimitOffsetPushDown.java | 3 +-
.../db/queryengine/plan/parser/ASTVisitor.java | 34 +-
.../plan/planner/LocalExecutionPlanner.java | 33 +-
.../plan/planner/OperatorTreeGenerator.java | 251 +++-
.../planner/distribution/ExchangeNodeAdder.java | 4 +-
.../plan/planner/distribution/SourceRewriter.java | 10 +-
.../distribution/WriteFragmentParallelPlanner.java | 8 +-
.../plan/planner/plan/node/PlanNodeType.java | 4 +-
.../plan/planner/plan/node/PlanVisitor.java | 4 +-
.../plan/planner/plan/node/WritePlanNode.java | 4 +-
.../plan/node/load/LoadSingleTsFileNode.java | 4 +-
.../planner/plan/node/load/LoadTsFileNode.java | 9 +-
.../plan/node/load/LoadTsFilePieceNode.java | 4 +-
.../node/metedata/write/ActivateTemplateNode.java | 4 +-
.../node/metedata/write/AlterTimeSeriesNode.java | 4 +-
.../metedata/write/BatchActivateTemplateNode.java | 4 +-
.../write/CreateAlignedTimeSeriesNode.java | 4 +-
.../metedata/write/CreateMultiTimeSeriesNode.java | 4 +-
.../node/metedata/write/CreateTimeSeriesNode.java | 4 +-
.../write/InternalBatchActivateTemplateNode.java | 4 +-
.../write/InternalCreateMultiTimeSeriesNode.java | 4 +-
.../write/InternalCreateTimeSeriesNode.java | 4 +-
.../metedata/write/view/CreateLogicalViewNode.java | 4 +-
.../plan/node/pipe/PipeEnrichedDeleteDataNode.java | 4 +-
.../plan/node/pipe/PipeEnrichedInsertNode.java | 4 +-
.../plan/node/pipe/PipeEnrichedWritePlanNode.java | 4 +-
...rgeNode.java => ActiveRegionScanMergeNode.java} | 52 +-
.../plan/node/source/DeviceRegionScanNode.java | 8 +-
.../planner/plan/node/source/RegionScanNode.java | 2 +
.../plan/node/source/TimeseriesRegionScanNode.java | 70 +-
.../planner/plan/node/write/DeleteDataNode.java | 5 +-
.../plan/node/write/InsertMultiTabletsNode.java | 4 +-
.../planner/plan/node/write/InsertRowNode.java | 4 +-
.../planner/plan/node/write/InsertRowsNode.java | 4 +-
.../plan/node/write/InsertRowsOfOneDeviceNode.java | 4 +-
.../planner/plan/node/write/InsertTabletNode.java | 4 +-
.../plan/scheduler/AsyncPlanNodeSender.java | 6 +-
.../scheduler/FragmentInstanceDispatcherImpl.java | 52 +-
.../queryengine/plan/statement/StatementType.java | 1 +
.../plan/statement/StatementVisitor.java | 10 +
.../plan/statement/crud/InsertTabletStatement.java | 4 +
.../statement/metadata/ShowDatabaseStatement.java | 4 +-
.../statement/sys/SetConfigurationStatement.java | 72 +
.../statement/sys/TestConnectionStatement.java | 62 +
.../transformation/api/LayerPointReader.java | 54 -
.../api/{LayerRowReader.java => LayerReader.java} | 20 +-
.../transformation/api/LayerRowWindowReader.java | 3 -
...izableRowRecordListBackedMultiColumnWindow.java | 6 +-
...wRecordListBackedMultiColumnWindowIterator.java | 6 +-
...ticSerializableTVListBackedSingleColumnRow.java | 2 +-
.../LayerPointReaderBackedSingleColumnRow.java | 99 --
.../dag/adapter/PointCollectorAdaptor.java | 97 ++
.../dag/builder/EvaluationDAGBuilder.java | 12 +-
.../dag/input/ConstantInputReader.java | 114 +-
.../transformation/dag/input/IUDFInputDataSet.java | 21 +-
.../dag/input/QueryDataSetInputLayer.java | 294 +---
.../dag/input/TsBlockInputDataSet.java | 37 +-
.../intermediate/ConstantIntermediateLayer.java | 17 +-
.../dag/intermediate/IntermediateLayer.java | 7 +-
.../MultiInputColumnIntermediateLayer.java | 797 -----------
.../dag/intermediate/MultiInputLayer.java | 665 +++++++++
...InputColumnMultiReferenceIntermediateLayer.java | 797 -----------
...nputColumnSingleReferenceIntermediateLayer.java | 668 ----------
.../SingleInputMultiReferenceLayer.java | 720 ++++++++++
.../SingleInputSingleReferenceLayer.java | 644 +++++++++
.../transformation/dag/memory/SafetyLine.java | 4 +
.../dag/transformer/Transformer.java | 102 +-
.../binary/ArithmeticAdditionTransformer.java | 7 +-
.../binary/ArithmeticBinaryTransformer.java | 31 +-
.../binary/ArithmeticDivisionTransformer.java | 7 +-
.../binary/ArithmeticModuloTransformer.java | 7 +-
.../ArithmeticMultiplicationTransformer.java | 7 +-
.../binary/ArithmeticSubtractionTransformer.java | 7 +-
.../dag/transformer/binary/BinaryTransformer.java | 273 ++--
.../binary/CompareBinaryTransformer.java | 33 +-
.../binary/CompareEqualToTransformer.java | 22 +-
.../binary/CompareGreaterEqualTransformer.java | 22 +-
.../binary/CompareGreaterThanTransformer.java | 21 +-
.../binary/CompareLessEqualTransformer.java | 22 +-
.../binary/CompareLessThanTransformer.java | 21 +-
.../binary/CompareNonEqualTransformer.java | 21 +-
.../transformer/binary/LogicAndTransformer.java | 6 +-
.../transformer/binary/LogicBinaryTransformer.java | 259 ++--
.../dag/transformer/binary/LogicOrTransformer.java | 6 +-
.../multi/MappableUDFQueryRowTransformer.java | 102 +-
.../transformer/multi/UDFQueryRowTransformer.java | 44 +-
.../multi/UDFQueryRowWindowTransformer.java | 21 +-
.../dag/transformer/multi/UDFQueryTransformer.java | 12 +-
.../multi/UniversalUDFQueryTransformer.java | 73 +-
.../transformer/ternary/BetweenTransformer.java | 41 +-
.../ternary/CompareTernaryTransformer.java | 55 +-
.../transformer/ternary/TernaryTransformer.java | 342 +++--
.../unary/ArithmeticNegationTransformer.java | 92 +-
.../dag/transformer/unary/InTransformer.java | 144 +-
.../dag/transformer/unary/IsNullTransformer.java | 39 +-
.../dag/transformer/unary/LogicNotTransformer.java | 32 +-
.../dag/transformer/unary/RegularTransformer.java | 35 +-
.../transformer/unary/TransparentTransformer.java | 37 +-
.../dag/transformer/unary/UnaryTransformer.java | 70 +-
.../unary/scalar/CastFunctionTransformer.java | 493 +++++--
.../unary/scalar/DiffFunctionTransformer.java | 159 ++-
.../unary/scalar/ReplaceFunctionTransformer.java | 42 +-
.../unary/scalar/RoundFunctionTransformer.java | 94 +-
.../unary/scalar/SubStringFunctionTransformer.java | 53 +-
.../transformation/dag/udf/UDTFExecutor.java | 153 ++-
.../transformation/dag/util/LayerCacheUtils.java | 189 +--
.../transformation/dag/util/TransformUtils.java | 46 +-
.../transformation/dag/util/TypeUtils.java | 79 ++
.../transformation/datastructure/TVColumns.java | 74 ++
.../iterator/ListForwardIterator.java} | 17 +-
.../iterator/RowListForwardIterator.java | 100 ++
.../iterator/TVListForwardIterator.java | 109 ++
.../row/ElasticSerializableRowList.java | 485 +++++++
.../row/ElasticSerializableRowRecordList.java | 314 -----
.../datastructure/row/SerializableRowList.java | 373 ++++++
.../row/SerializableRowRecordList.java | 254 ----
.../tv/ElasticSerializableBinaryTVList.java | 160 ++-
.../tv/ElasticSerializableTVList.java | 364 ++---
.../tv/SerializableBooleanTVList.java | 75 --
.../datastructure/tv/SerializableDoubleTVList.java | 75 --
.../datastructure/tv/SerializableFloatTVList.java | 75 --
.../datastructure/tv/SerializableIntTVList.java | 73 -
.../datastructure/tv/SerializableLongTVList.java | 75 --
.../datastructure/tv/SerializableTVList.java | 383 +++++-
.../BinaryUtils.java} | 47 +-
.../schemaengine/metric/SchemaEngineMemMetric.java | 4 +-
.../schemaregion/utils/ResourceByPathUtils.java | 3 +-
.../java/org/apache/iotdb/db/service/DataNode.java | 28 +-
.../db/service/metrics/CompactionMetrics.java | 2 +-
.../iotdb/db/storageengine/StorageEngine.java | 71 +-
.../db/storageengine/dataregion/DataRegion.java | 8 +-
.../CompactionLastTimeCheckFailedException.java | 17 +
.../performer/impl/FastCompactionPerformer.java | 11 +-
.../impl/ReadChunkCompactionPerformer.java | 9 +-
.../execute/recover/CompactionRecoverManager.java | 2 +-
.../execute/utils/CompactionPathUtils.java | 11 +-
.../execute/utils/MultiTsFileDeviceIterator.java | 162 +--
.../readchunk/SingleSeriesCompactionExecutor.java | 21 +-
.../executor/readchunk/loader/ChunkLoader.java | 3 +
.../compaction/io/CompactionTsFileReader.java | 119 +-
.../compaction/repair/RepairDataFileScanUtil.java | 18 +-
.../dataregion/memtable/AbstractMemTable.java | 93 +-
.../dataregion/memtable/TsFileProcessor.java | 110 +-
.../read/QueryDataSourceForRegionScan.java | 38 +-
.../dataregion/read/filescan/IChunkHandle.java | 13 +-
.../dataregion/read/filescan/IFileScanHandle.java | 15 +-
.../filescan/impl/ClosedFileScanHandleImpl.java | 48 +-
.../filescan/impl/DiskAlignedChunkHandleImpl.java | 15 +-
.../read/filescan/impl/DiskChunkHandleImpl.java | 51 +-
.../filescan/impl/MemAlignedChunkHandleImpl.java | 17 +-
.../read/filescan/impl/MemChunkHandleImpl.java | 25 +-
.../filescan/impl/UnclosedFileScanHandleImpl.java | 76 +-
.../read/filescan/model/AbstractChunkOffset.java | 16 +-
.../model/AbstractDeviceChunkMetaData.java | 8 +-
.../read/filescan/model/AlignedChunkOffset.java | 19 +-
.../filescan/model/AlignedDeviceChunkMetaData.java | 48 +-
.../read/filescan/model/ChunkOffset.java | 12 +-
.../read/filescan/model/DeviceChunkMetaData.java | 20 +-
.../dataregion/tsfile/TsFileResource.java | 22 +-
.../tsfile/generator/TsFileNameGenerator.java | 15 +-
.../tsfile/timeindex/DeviceTimeIndex.java | 16 +
.../dataregion/tsfile/timeindex/FileTimeIndex.java | 5 +
.../dataregion/utils/SharedTimeDataBuffer.java | 10 +-
.../dataregion/utils/TsFileResourceUtils.java | 6 +-
.../storageengine/rescon/disk/FolderManager.java | 4 +
.../agent/SubscriptionAgentLauncher.java | 8 +-
.../agent/SubscriptionBrokerAgent.java | 11 +-
.../agent/SubscriptionConsumerAgent.java | 29 +-
.../agent/SubscriptionReceiverAgent.java | 6 +-
.../subscription/agent/SubscriptionTopicAgent.java | 32 +-
.../db/subscription/broker/SubscriptionBroker.java | 46 +-
.../broker/SubscriptionPrefetchingQueue.java | 54 +-
.../SubscriptionPrefetchingTabletsQueue.java | 21 +
.../broker/SubscriptionPrefetchingTsFileQueue.java | 59 +-
.../db/subscription/event/SubscriptionEvent.java | 6 +
.../receiver/SubscriptionReceiverV1.java | 47 +-
.../task/subtask/SubscriptionConnectorSubtask.java | 18 +-
.../SubscriptionConnectorSubtaskLifeCycle.java | 57 +-
.../org/apache/iotdb/db/utils/DateTimeUtils.java | 4 +-
.../java/org/apache/iotdb/db/utils/MemUtils.java | 2 +-
.../apache/iotdb/db/utils/ModificationUtils.java | 12 +
.../apache/iotdb/db/utils/TypeInferenceUtils.java | 34 +-
.../connector/PipeDataNodeThriftRequestTest.java | 120 +-
.../db/pipe/event/PipeDataTypeTransformerTest.java | 13 +-
.../pipe/event/PipeTabletInsertionEventTest.java | 40 +-
.../schema/SchemaQueryScanOperatorTest.java | 1 +
.../plan/analyze/QueryTimePartitionTest.java | 33 +-
.../plan/optimization/LimitOffsetPushDownTest.java | 28 +
.../distribution/RegionScanPlanningTest.java | 6 +-
.../logical/RegionScanLogicalPlannerTest.java | 24 +-
.../builder/EvaluationDAGBuilderTest.java | 4 +-
.../ElasticSerializableRowListTest.java | 415 ++++++
.../ElasticSerializableRowRecordListTest.java | 294 ----
.../ElasticSerializableTVListTest.java | 352 ++---
.../SerializableBinaryTVListTest.java | 87 --
.../SerializableBooleanTVListTest.java | 85 --
.../SerializableDoubleTVListTest.java | 84 --
.../datastructure/SerializableFloatTVListTest.java | 84 --
.../datastructure/SerializableIntTVListTest.java | 84 --
.../datastructure/SerializableLongTVListTest.java | 84 --
...dListTest.java => SerializableRowListTest.java} | 119 +-
.../datastructure/SerializableTVListTest.java | 452 ++++++-
.../TsFileValidationCorrectnessTests.java | 28 +
.../inner/InnerSequenceCompactionSpeedTest.java | 126 ++
.../settle/SettleCompactionTaskTest.java | 44 +-
.../compaction/utils/CompactionConfigRestorer.java | 2 -
.../utils/MultiTsFileDeviceIteratorTest.java | 3 +-
.../iotdb/db/utils/TypeInferenceUtilsTest.java | 2 +-
iotdb-core/metrics/core/pom.xml | 4 +-
iotdb-core/metrics/interface/pom.xml | 8 +-
.../metrics/metricsets/system/SystemMetrics.java | 4 +-
iotdb-core/metrics/pom.xml | 2 +-
iotdb-core/node-commons/pom.xml | 109 +-
.../resources/conf/generate_properties.bat | 65 +
.../assembly/resources/conf/generate_properties.sh | 59 +
.../resources/conf/iotdb-system.properties | 399 +++++-
.../assembly/resources/sbin/destroy-datanode.bat | 34 +-
.../assembly/resources/sbin/destroy-datanode.sh | 2 +
.../iotdb/commons/client/ClientPoolFactory.java | 130 +-
...a => AsyncConfigNodeInternalServiceClient.java} | 23 +-
...ava => AsyncDataNodeExternalServiceClient.java} | 39 +-
.../async/AsyncPipeConsensusServiceClient.java} | 57 +-
.../container/PipeConsensusClientMgrContainer.java | 91 ++
.../property/PipeConsensusClientProperty.java | 99 ++
.../client/request/AsyncRequestContext.java | 138 ++
.../client/request/AsyncRequestManager.java | 192 +++
.../client/request/AsyncRequestRPCHandler.java} | 49 +-
...nfigNodeInternalServiceAsyncRequestManager.java | 43 +
.../DataNodeInternalServiceRequestManager.java | 43 +
.../apache/iotdb/commons/client/request/Utils.java | 78 ++
.../sync/SyncPipeConsensusServiceClient.java | 139 ++
.../iotdb/commons/concurrent/ThreadName.java | 14 +
.../threadpool/WrappedThreadPoolExecutor.java | 7 +-
.../apache/iotdb/commons/conf/CommonConfig.java | 45 +-
.../iotdb/commons/conf/CommonDescriptor.java | 37 +-
.../commons/conf/ConfigFileAutoUpdateTool.java | 126 --
.../iotdb/commons/conf/ConfigurationFileUtils.java | 274 ++++
.../iotdb/commons/consensus/ConsensusGroupId.java | 29 +
.../consensus/index/impl/HybridProgressIndex.java | 4 +
.../consensus/index/impl/RecoverProgressIndex.java | 4 +
.../enums/PipeRemainingTimeRateAverageTime.java} | 34 +-
.../commons/partition/SeriesPartitionTable.java | 28 +-
.../org/apache/iotdb/commons/path/AlignedPath.java | 5 +-
.../apache/iotdb/commons/path/MeasurementPath.java | 3 +
.../commons/pipe/agent/task/PipeTaskAgent.java | 36 +-
.../iotdb/commons/pipe/config/PipeConfig.java | 15 +-
.../config/constant/PipeConnectorConstant.java | 13 +
.../config/constant/PipeExtractorConstant.java | 10 +
.../pipe/connector/compressor/PipeCompressor.java | 19 +
.../connector/compressor/PipeCompressorConfig.java | 37 +-
.../compressor/PipeCompressorFactory.java | 62 +-
.../connector/compressor/PipeGZIPCompressor.java | 7 +
.../connector/compressor/PipeLZ4Compressor.java | 7 +
.../connector/compressor/PipeLZMA2Compressor.java | 7 +
.../connector/compressor/PipeSnappyCompressor.java | 7 +
.../connector/compressor/PipeZSTDCompressor.java | 22 +-
.../request/PipeConsensusRequestType.java | 35 +-
.../request/PipeConsensusRequestVersion.java} | 24 +-
.../request/PipeConsensusTransferFilePieceReq.java | 139 ++
.../request/PipeConsensusTransferFileSealReq.java | 138 ++
.../PipeConsensusTransferFileSealWithModReq.java | 177 +++
.../PipeConsensusTransferFilePieceResp.java | 110 ++
.../thrift/request/PipeTransferCompressedReq.java | 36 +-
.../pipe/connector/protocol/IoTDBConnector.java | 53 +-
.../iotdb/commons/pipe/event/EnrichedEvent.java | 53 +-
.../commons/pipe/event/PipeSnapshotEvent.java | 3 +-
.../commons/pipe/event/PipeWritePlanEvent.java | 3 +-
.../commons/pipe/event/ProgressReportEvent.java | 7 +-
.../execution/executor/PipeSubtaskExecutor.java | 30 +-
.../extractor/IoTDBNonDataRegionExtractor.java | 11 +-
.../commons/pipe/metric/PipeRemainingOperator.java | 87 ++
.../commons/pipe/pattern/IoTDBPipePattern.java | 4 +-
.../pipe/plugin/builtin/BuiltinPipePlugin.java | 7 +
.../consensus/PipeConsensusAsyncConnector.java | 38 +-
.../pipeconsensus/PipeConsensusProcessor.java | 38 +-
.../pipe/progress/PipeEventCommitManager.java | 51 +-
.../commons/pipe/progress/PipeEventCommitter.java | 4 +
.../iotdb/commons/pipe/task/DecoratingLock.java | 44 -
.../commons/pipe/task/meta/PipeStaticMeta.java | 1 +
.../iotdb/commons/pipe/task/meta/PipeType.java | 3 +
.../task/subtask/PipeAbstractConnectorSubtask.java | 42 +-
.../pipe/task/subtask/PipeReportableSubtask.java | 28 +-
.../apache/iotdb/commons/schema/ttl/TTLCache.java | 1 +
.../apache/iotdb/commons/service/ServiceType.java | 1 +
.../service/metric/PerformanceOverviewMetrics.java | 21 +
.../iotdb/commons/service/metric/enums/Metric.java | 5 +
.../meta/consumer/ConsumerGroupMeta.java | 79 +-
.../commons/subscription/meta/topic/TopicMeta.java | 4 +-
.../iotdb/commons/udf/utils/MasterRepairUtil.java | 2 +-
.../commons/udf/utils/UDFDataTypeTransformer.java | 12 -
.../apache/iotdb/commons/utils/StatusUtils.java | 22 +-
.../iotdb/commons/utils/TimePartitionUtils.java | 4 +
.../utils/function/CheckedTriConsumer.java} | 14 +-
iotdb-core/pom.xml | 2 +-
iotdb-protocol/openapi/pom.xml | 2 +-
iotdb-protocol/pom.xml | 2 +-
iotdb-protocol/thrift-commons/pom.xml | 2 +-
.../thrift-commons/src/main/thrift/common.thrift | 52 +-
iotdb-protocol/thrift-confignode/pom.xml | 4 +-
.../src/main/thrift/confignode.thrift | 14 +
iotdb-protocol/thrift-consensus/pom.xml | 4 +-
.../src/main/thrift/pipeconsensus.thrift | 109 ++
iotdb-protocol/thrift-datanode/pom.xml | 4 +-
.../thrift-datanode/src/main/thrift/client.thrift | 7 +
.../src/main/thrift/datanode.thrift | 12 +
library-udf/pom.xml | 4 +-
.../iotdb/library/series/util/ConsecutiveUtil.java | 2 +-
pom.xml | 1012 +-------------
713 files changed, 34619 insertions(+), 13432 deletions(-)
rename .mvn/{gradle-enterprise.xml => develocity.xml} (69%)
create mode 100644
example/jdbc/src/main/java/org/apache/iotdb/JDBCCharsetExample.java
rename
integration-test/src/test/java/org/apache/iotdb/db/it/{IOTDBLoadTsFileIT.java
=> IoTDBLoadTsFileIT.java} (65%)
create mode 100644
integration-test/src/test/java/org/apache/iotdb/db/it/IoTDBSetConfigurationIT.java
create mode 100644
integration-test/src/test/java/org/apache/iotdb/db/it/IoTDBVerifyConnectionIT.java
create mode 100644
integration-test/src/test/java/org/apache/iotdb/db/it/orderBy/IoTDBOrderByForDebugIT.java
create mode 100644
integration-test/src/test/java/org/apache/iotdb/db/it/regionscan/IoTDBActiveRegionScanIT.java
create mode 100644
integration-test/src/test/java/org/apache/iotdb/db/it/regionscan/IoTDBActiveRegionScanIT2.java
create mode 100644
integration-test/src/test/java/org/apache/iotdb/db/it/regionscan/IoTDBActiveRegionScanWithModsIT.java
create mode 100644
integration-test/src/test/java/org/apache/iotdb/db/it/regionscan/IoTDBActiveRegionScanWithModsIT2.java
create mode 100644
integration-test/src/test/java/org/apache/iotdb/db/it/udf/IoTDBUDFWindowQuery2IT.java
create mode 100644
integration-test/src/test/java/org/apache/iotdb/subscription/it/AbstractSubscriptionIT.java
create mode 100644
integration-test/src/test/java/org/apache/iotdb/subscription/it/SkipOnSetUpFailure.java
rename integration-test/src/test/java/org/apache/iotdb/subscription/it/{local
=> cluster}/IoTDBSubscriptionRestartIT.java (87%)
create mode 100644
integration-test/src/test/java/org/apache/iotdb/subscription/it/dual/IoTDBSubscriptionTimePrecisionIT.java
copy
iotdb-core/datanode/src/main/java/org/apache/iotdb/db/queryengine/transformation/dag/transformer/binary/LogicOrTransformer.java
=>
integration-test/src/test/java/org/apache/iotdb/subscription/it/local/AbstractSubscriptionLocalIT.java
(62%)
copy
integration-test/src/test/java/org/apache/iotdb/tools/it/{ImportDataTestIT.java
=> ExportSchemaTestIT.java} (61%)
copy
integration-test/src/test/java/org/apache/iotdb/tools/it/{ImportDataTestIT.java
=> ImportSchemaTestIT.java} (81%)
copy iotdb-client/cli/src/assembly/resources/tools/{load-tsfile.bat =>
export-schema.bat} (50%)
create mode 100644
iotdb-client/cli/src/assembly/resources/tools/export-schema.sh
copy iotdb-client/cli/src/assembly/resources/tools/{load-tsfile.bat =>
import-schema.bat} (50%)
create mode 100644
iotdb-client/cli/src/assembly/resources/tools/import-schema.sh
mode change 100644 => 100755
iotdb-client/cli/src/assembly/resources/tools/load-tsfile.bat
mode change 100644 => 100755
iotdb-client/cli/src/assembly/resources/tools/load-tsfile.sh
copy
iotdb-client/cli/src/main/java/org/apache/iotdb/tool/{AbstractDataTool.java =>
AbstractSchemaTool.java} (60%)
create mode 100644
iotdb-client/cli/src/main/java/org/apache/iotdb/tool/ExportSchema.java
create mode 100644
iotdb-client/cli/src/main/java/org/apache/iotdb/tool/ImportSchema.java
create mode 100644
iotdb-client/cli/src/main/java/org/apache/iotdb/tool/ImportTsFile.java
copy
iotdb-core/datanode/src/main/java/org/apache/iotdb/db/storageengine/dataregion/read/filescan/model/DeviceChunkMetaData.java
=>
iotdb-client/service-rpc/src/main/java/org/apache/iotdb/rpc/subscription/exception/SubscriptionIdentifierSemanticException.java
(53%)
copy iotdb-api/pipe-api/src/main/java/org/apache/iotdb/pipe/api/type/Type.java
=>
iotdb-client/service-rpc/src/main/java/org/apache/iotdb/rpc/subscription/payload/poll/TerminationPayload.java
(63%)
create mode 100644
iotdb-client/session/src/main/java/org/apache/iotdb/session/subscription/util/IdentifierUtils.java
copy
iotdb-core/confignode/src/main/java/org/apache/iotdb/confignode/client/{ConfigNodeRequestType.java
=> CnToCnNodeRequestType.java} (87%)
rename
iotdb-core/confignode/src/main/java/org/apache/iotdb/confignode/client/{DataNodeRequestType.java
=> CnToDnRequestType.java} (95%)
delete mode 100644
iotdb-core/confignode/src/main/java/org/apache/iotdb/confignode/client/async/AsyncDataNodeClientPool.java
create mode 100644
iotdb-core/confignode/src/main/java/org/apache/iotdb/confignode/client/async/CnToCnInternalServiceAsyncRequestManager.java
create mode 100644
iotdb-core/confignode/src/main/java/org/apache/iotdb/confignode/client/async/CnToDnInternalServiceAsyncRequestManager.java
copy
iotdb-core/{datanode/src/main/java/org/apache/iotdb/db/queryengine/transformation/dag/transformer/binary/LogicOrTransformer.java
=>
confignode/src/main/java/org/apache/iotdb/confignode/client/async/handlers/ConfigNodeAsyncRequestContext.java}
(51%)
create mode 100644
iotdb-core/confignode/src/main/java/org/apache/iotdb/confignode/client/async/handlers/DataNodeAsyncRequestContext.java
create mode 100644
iotdb-core/confignode/src/main/java/org/apache/iotdb/confignode/client/async/handlers/rpc/ConfigNodeAsyncRequestRPCHandler.java
copy
iotdb-core/confignode/src/main/java/org/apache/iotdb/confignode/client/async/handlers/rpc/{AsyncTSStatusRPCHandler.java
=> ConfigNodeTSStatusRPCHandler.java} (70%)
rename
iotdb-core/confignode/src/main/java/org/apache/iotdb/confignode/client/async/handlers/{AsyncClientHandler.java
=> rpc/DataNodeAsyncRequestRPCHandler.java} (58%)
copy
iotdb-core/confignode/src/main/java/org/apache/iotdb/confignode/client/async/handlers/rpc/{AsyncTSStatusRPCHandler.java
=> DataNodeTSStatusRPCHandler.java} (87%)
copy
iotdb-core/confignode/src/main/java/org/apache/iotdb/confignode/client/async/handlers/rpc/{PipeHeartbeatRPCHandler.java
=> SubmitTestConnectionTaskRPCHandler.java} (59%)
create mode 100644
iotdb-core/confignode/src/main/java/org/apache/iotdb/confignode/client/async/handlers/rpc/SubmitTestConnectionTaskToConfigNodeRPCHandler.java
create mode 100644
iotdb-core/consensus/src/main/java/org/apache/iotdb/consensus/config/PipeConsensusConfig.java
create mode 100644
iotdb-core/consensus/src/main/java/org/apache/iotdb/consensus/pipe/PipeConsensus.java
create mode 100644
iotdb-core/consensus/src/main/java/org/apache/iotdb/consensus/pipe/PipeConsensusPeerManager.java
create mode 100644
iotdb-core/consensus/src/main/java/org/apache/iotdb/consensus/pipe/PipeConsensusServerImpl.java
copy
iotdb-core/{confignode/src/main/java/org/apache/iotdb/confignode/client/ConfigNodeRequestType.java
=>
consensus/src/main/java/org/apache/iotdb/consensus/pipe/consensuspipe/ConsensusPipeConnector.java}
(74%)
copy
iotdb-core/{datanode/src/main/java/org/apache/iotdb/db/queryengine/plan/analyze/IAnalysis.java
=>
consensus/src/main/java/org/apache/iotdb/consensus/pipe/consensuspipe/ConsensusPipeDispatcher.java}
(56%)
copy
iotdb-core/{confignode/src/main/java/org/apache/iotdb/confignode/client/ConfigNodeRequestType.java
=>
consensus/src/main/java/org/apache/iotdb/consensus/pipe/consensuspipe/ConsensusPipeGuardian.java}
(74%)
create mode 100644
iotdb-core/consensus/src/main/java/org/apache/iotdb/consensus/pipe/consensuspipe/ConsensusPipeManager.java
create mode 100644
iotdb-core/consensus/src/main/java/org/apache/iotdb/consensus/pipe/consensuspipe/ConsensusPipeName.java
copy
iotdb-core/{datanode/src/main/java/org/apache/iotdb/db/queryengine/plan/planner/plan/node/WritePlanNode.java
=>
consensus/src/main/java/org/apache/iotdb/consensus/pipe/consensuspipe/ConsensusPipeReceiver.java}
(68%)
copy
iotdb-core/{confignode/src/main/java/org/apache/iotdb/confignode/client/ConfigNodeRequestType.java
=>
consensus/src/main/java/org/apache/iotdb/consensus/pipe/consensuspipe/ConsensusPipeSelector.java}
(74%)
copy
integration-test/src/test/java/org/apache/iotdb/subscription/it/IoTDBSubscriptionITConstant.java
=>
iotdb-core/consensus/src/main/java/org/apache/iotdb/consensus/pipe/consensuspipe/ProgressIndexManager.java
(64%)
create mode 100644
iotdb-core/consensus/src/main/java/org/apache/iotdb/consensus/pipe/metric/PipeConsensusServerMetrics.java
create mode 100644
iotdb-core/consensus/src/main/java/org/apache/iotdb/consensus/pipe/metric/PipeConsensusSyncLagManager.java
create mode 100644
iotdb-core/consensus/src/main/java/org/apache/iotdb/consensus/pipe/service/PipeConsensusRPCService.java
copy
iotdb-core/{datanode/src/main/java/org/apache/iotdb/db/storageengine/dataregion/read/filescan/impl/MemChunkHandleImpl.java
=>
consensus/src/main/java/org/apache/iotdb/consensus/pipe/service/PipeConsensusRPCServiceHandler.java}
(50%)
copy
iotdb-core/{confignode/src/main/java/org/apache/iotdb/confignode/client/ConfigNodeRequestType.java
=>
consensus/src/main/java/org/apache/iotdb/consensus/pipe/service/PipeConsensusRPCServiceMBean.java}
(74%)
create mode 100644
iotdb-core/consensus/src/main/java/org/apache/iotdb/consensus/pipe/service/PipeConsensusRPCServiceProcessor.java
create mode 100644
iotdb-core/datanode/src/main/java/org/apache/iotdb/db/pipe/connector/protocol/pipeconsensus/PipeConsensusAsyncConnector.java
create mode 100644
iotdb-core/datanode/src/main/java/org/apache/iotdb/db/pipe/connector/protocol/pipeconsensus/PipeConsensusSyncConnector.java
create mode 100644
iotdb-core/datanode/src/main/java/org/apache/iotdb/db/pipe/connector/protocol/pipeconsensus/handler/PipeConsensusTabletBatchEventHandler.java
create mode 100644
iotdb-core/datanode/src/main/java/org/apache/iotdb/db/pipe/connector/protocol/pipeconsensus/handler/PipeConsensusTabletInsertNodeEventHandler.java
copy
iotdb-core/datanode/src/main/java/org/apache/iotdb/db/pipe/connector/protocol/{thrift/async/handler/PipeTransferTabletInsertionEventHandler.java
=> pipeconsensus/handler/PipeConsensusTabletInsertionEventHandler.java} (58%)
copy
iotdb-core/datanode/src/main/java/org/apache/iotdb/db/pipe/connector/protocol/{thrift/async/handler/PipeTransferTsFileInsertionEventHandler.java
=> pipeconsensus/handler/PipeConsensusTsFileInsertionEventHandler.java} (56%)
copy
iotdb-core/datanode/src/main/java/org/apache/iotdb/db/{queryengine/plan/planner/plan/node/WritePlanNode.java
=>
pipe/connector/protocol/pipeconsensus/payload/builder/PipeConsensusAsyncBatchReqBuilder.java}
(57%)
create mode 100644
iotdb-core/datanode/src/main/java/org/apache/iotdb/db/pipe/connector/protocol/pipeconsensus/payload/builder/PipeConsensusSyncBatchReqBuilder.java
create mode 100644
iotdb-core/datanode/src/main/java/org/apache/iotdb/db/pipe/connector/protocol/pipeconsensus/payload/builder/PipeConsensusTransferBatchReqBuilder.java
create mode 100644
iotdb-core/datanode/src/main/java/org/apache/iotdb/db/pipe/connector/protocol/pipeconsensus/payload/request/PipeConsensusTabletBatchReq.java
create mode 100644
iotdb-core/datanode/src/main/java/org/apache/iotdb/db/pipe/connector/protocol/pipeconsensus/payload/request/PipeConsensusTabletBinaryReq.java
create mode 100644
iotdb-core/datanode/src/main/java/org/apache/iotdb/db/pipe/connector/protocol/pipeconsensus/payload/request/PipeConsensusTabletInsertNodeReq.java
create mode 100644
iotdb-core/datanode/src/main/java/org/apache/iotdb/db/pipe/connector/protocol/pipeconsensus/payload/request/PipeConsensusTsFilePieceReq.java
create mode 100644
iotdb-core/datanode/src/main/java/org/apache/iotdb/db/pipe/connector/protocol/pipeconsensus/payload/request/PipeConsensusTsFilePieceWithModReq.java
create mode 100644
iotdb-core/datanode/src/main/java/org/apache/iotdb/db/pipe/connector/protocol/pipeconsensus/payload/request/PipeConsensusTsFileSealReq.java
create mode 100644
iotdb-core/datanode/src/main/java/org/apache/iotdb/db/pipe/connector/protocol/pipeconsensus/payload/request/PipeConsensusTsFileSealWithModReq.java
create mode 100644
iotdb-core/datanode/src/main/java/org/apache/iotdb/db/pipe/consensus/ConsensusPipeDataNodeDispatcher.java
create mode 100644
iotdb-core/datanode/src/main/java/org/apache/iotdb/db/pipe/consensus/ConsensusPipeDataNodeRuntimeAgentGuardian.java
create mode 100644
iotdb-core/datanode/src/main/java/org/apache/iotdb/db/pipe/consensus/PipeConsensusConnectorMetrics.java
create mode 100644
iotdb-core/datanode/src/main/java/org/apache/iotdb/db/pipe/consensus/PipeConsensusReceiverMetrics.java
copy
iotdb-core/datanode/src/main/java/org/apache/iotdb/db/pipe/{execution/PipeProcessorSubtaskExecutor.java
=> consensus/PipeConsensusSubtaskExecutor.java} (77%)
create mode 100644
iotdb-core/datanode/src/main/java/org/apache/iotdb/db/pipe/consensus/ProgressIndexDataNodeManager.java
create mode 100644
iotdb-core/datanode/src/main/java/org/apache/iotdb/db/pipe/processor/pipeconsensus/PipeConsensusProcessor.java
rename
iotdb-core/datanode/src/main/java/org/apache/iotdb/db/pipe/progress/{SimpleConsensusProgressIndexAssigner.java
=> SimpleProgressIndexAssigner.java} (91%)
create mode 100644
iotdb-core/datanode/src/main/java/org/apache/iotdb/db/pipe/receiver/protocol/pipeconsensus/PipeConsensusReceiver.java
create mode 100644
iotdb-core/datanode/src/main/java/org/apache/iotdb/db/pipe/receiver/protocol/pipeconsensus/PipeConsensusReceiverAgent.java
copy
iotdb-core/{confignode/src/main/java/org/apache/iotdb/confignode/client/async/handlers/rpc/AsyncTSStatusRPCHandler.java
=>
datanode/src/main/java/org/apache/iotdb/db/protocol/client/cn/AsyncConfigNodeTSStatusRPCHandler.java}
(70%)
create mode 100644
iotdb-core/datanode/src/main/java/org/apache/iotdb/db/protocol/client/cn/ConfigNodeAsyncRequestRPCHandler.java
create mode 100644
iotdb-core/datanode/src/main/java/org/apache/iotdb/db/protocol/client/cn/DnToCnInternalServiceAsyncRequestManager.java
copy
iotdb-core/{confignode/src/main/java/org/apache/iotdb/confignode/client/ConfigNodeRequestType.java
=>
datanode/src/main/java/org/apache/iotdb/db/protocol/client/cn/DnToCnRequestType.java}
(74%)
rename
iotdb-core/{confignode/src/main/java/org/apache/iotdb/confignode/client/async/handlers/rpc
=>
datanode/src/main/java/org/apache/iotdb/db/protocol/client/dn}/AsyncTSStatusRPCHandler.java
(90%)
create mode 100644
iotdb-core/datanode/src/main/java/org/apache/iotdb/db/protocol/client/dn/DataNodeAsyncRequestRPCHandler.java
create mode 100644
iotdb-core/datanode/src/main/java/org/apache/iotdb/db/protocol/client/dn/DataNodeExternalServiceAsyncRequestManager.java
create mode 100644
iotdb-core/datanode/src/main/java/org/apache/iotdb/db/protocol/client/dn/DataNodeMPPServiceAsyncRequestManager.java
create mode 100644
iotdb-core/datanode/src/main/java/org/apache/iotdb/db/protocol/client/dn/DnToDnInternalServiceAsyncRequestManager.java
copy
iotdb-core/{confignode/src/main/java/org/apache/iotdb/confignode/client/ConfigNodeRequestType.java
=>
datanode/src/main/java/org/apache/iotdb/db/protocol/client/dn/DnToDnRequestType.java}
(74%)
create mode 100644
iotdb-core/datanode/src/main/java/org/apache/iotdb/db/queryengine/execution/operator/process/ActiveRegionScanMergeOperator.java
create mode 100644
iotdb-core/datanode/src/main/java/org/apache/iotdb/db/queryengine/execution/operator/source/AbstractRegionScanDataSourceOperator.java
create mode 100644
iotdb-core/datanode/src/main/java/org/apache/iotdb/db/queryengine/execution/operator/source/AbstractRegionScanForActiveDataUtil.java
create mode 100644
iotdb-core/datanode/src/main/java/org/apache/iotdb/db/queryengine/execution/operator/source/ActiveDeviceRegionScanOperator.java
create mode 100644
iotdb-core/datanode/src/main/java/org/apache/iotdb/db/queryengine/execution/operator/source/ActiveTimeSeriesRegionScanOperator.java
create mode 100644
iotdb-core/datanode/src/main/java/org/apache/iotdb/db/queryengine/execution/operator/source/RegionScanForActiveDeviceUtil.java
create mode 100644
iotdb-core/datanode/src/main/java/org/apache/iotdb/db/queryengine/execution/operator/source/RegionScanForActiveTimeSeriesUtil.java
create mode 100644
iotdb-core/datanode/src/main/java/org/apache/iotdb/db/queryengine/plan/execution/config/sys/SetConfigurationTask.java
create mode 100644
iotdb-core/datanode/src/main/java/org/apache/iotdb/db/queryengine/plan/execution/config/sys/TestConnectionTask.java
rename
iotdb-core/datanode/src/main/java/org/apache/iotdb/db/queryengine/plan/planner/plan/node/process/{RegionMergeNode.java
=> ActiveRegionScanMergeNode.java} (70%)
create mode 100644
iotdb-core/datanode/src/main/java/org/apache/iotdb/db/queryengine/plan/statement/sys/SetConfigurationStatement.java
create mode 100644
iotdb-core/datanode/src/main/java/org/apache/iotdb/db/queryengine/plan/statement/sys/TestConnectionStatement.java
delete mode 100644
iotdb-core/datanode/src/main/java/org/apache/iotdb/db/queryengine/transformation/api/LayerPointReader.java
rename
iotdb-core/datanode/src/main/java/org/apache/iotdb/db/queryengine/transformation/api/{LayerRowReader.java
=> LayerReader.java} (71%)
delete mode 100644
iotdb-core/datanode/src/main/java/org/apache/iotdb/db/queryengine/transformation/dag/adapter/LayerPointReaderBackedSingleColumnRow.java
create mode 100644
iotdb-core/datanode/src/main/java/org/apache/iotdb/db/queryengine/transformation/dag/adapter/PointCollectorAdaptor.java
delete mode 100644
iotdb-core/datanode/src/main/java/org/apache/iotdb/db/queryengine/transformation/dag/intermediate/MultiInputColumnIntermediateLayer.java
create mode 100644
iotdb-core/datanode/src/main/java/org/apache/iotdb/db/queryengine/transformation/dag/intermediate/MultiInputLayer.java
delete mode 100644
iotdb-core/datanode/src/main/java/org/apache/iotdb/db/queryengine/transformation/dag/intermediate/SingleInputColumnMultiReferenceIntermediateLayer.java
delete mode 100644
iotdb-core/datanode/src/main/java/org/apache/iotdb/db/queryengine/transformation/dag/intermediate/SingleInputColumnSingleReferenceIntermediateLayer.java
create mode 100644
iotdb-core/datanode/src/main/java/org/apache/iotdb/db/queryengine/transformation/dag/intermediate/SingleInputMultiReferenceLayer.java
create mode 100644
iotdb-core/datanode/src/main/java/org/apache/iotdb/db/queryengine/transformation/dag/intermediate/SingleInputSingleReferenceLayer.java
create mode 100644
iotdb-core/datanode/src/main/java/org/apache/iotdb/db/queryengine/transformation/dag/util/TypeUtils.java
create mode 100644
iotdb-core/datanode/src/main/java/org/apache/iotdb/db/queryengine/transformation/datastructure/TVColumns.java
copy
iotdb-core/{confignode/src/main/java/org/apache/iotdb/confignode/client/ConfigNodeRequestType.java
=>
datanode/src/main/java/org/apache/iotdb/db/queryengine/transformation/datastructure/iterator/ListForwardIterator.java}
(74%)
create mode 100644
iotdb-core/datanode/src/main/java/org/apache/iotdb/db/queryengine/transformation/datastructure/iterator/RowListForwardIterator.java
create mode 100644
iotdb-core/datanode/src/main/java/org/apache/iotdb/db/queryengine/transformation/datastructure/iterator/TVListForwardIterator.java
create mode 100644
iotdb-core/datanode/src/main/java/org/apache/iotdb/db/queryengine/transformation/datastructure/row/ElasticSerializableRowList.java
delete mode 100644
iotdb-core/datanode/src/main/java/org/apache/iotdb/db/queryengine/transformation/datastructure/row/ElasticSerializableRowRecordList.java
create mode 100644
iotdb-core/datanode/src/main/java/org/apache/iotdb/db/queryengine/transformation/datastructure/row/SerializableRowList.java
delete mode 100644
iotdb-core/datanode/src/main/java/org/apache/iotdb/db/queryengine/transformation/datastructure/row/SerializableRowRecordList.java
delete mode 100644
iotdb-core/datanode/src/main/java/org/apache/iotdb/db/queryengine/transformation/datastructure/tv/SerializableBooleanTVList.java
delete mode 100644
iotdb-core/datanode/src/main/java/org/apache/iotdb/db/queryengine/transformation/datastructure/tv/SerializableDoubleTVList.java
delete mode 100644
iotdb-core/datanode/src/main/java/org/apache/iotdb/db/queryengine/transformation/datastructure/tv/SerializableFloatTVList.java
delete mode 100644
iotdb-core/datanode/src/main/java/org/apache/iotdb/db/queryengine/transformation/datastructure/tv/SerializableIntTVList.java
delete mode 100644
iotdb-core/datanode/src/main/java/org/apache/iotdb/db/queryengine/transformation/datastructure/tv/SerializableLongTVList.java
rename
iotdb-core/datanode/src/main/java/org/apache/iotdb/db/queryengine/transformation/datastructure/{tv/SerializableBinaryTVList.java
=> util/BinaryUtils.java} (51%)
create mode 100644
iotdb-core/datanode/src/test/java/org/apache/iotdb/db/queryengine/transformation/datastructure/ElasticSerializableRowListTest.java
delete mode 100644
iotdb-core/datanode/src/test/java/org/apache/iotdb/db/queryengine/transformation/datastructure/ElasticSerializableRowRecordListTest.java
delete mode 100644
iotdb-core/datanode/src/test/java/org/apache/iotdb/db/queryengine/transformation/datastructure/SerializableBinaryTVListTest.java
delete mode 100644
iotdb-core/datanode/src/test/java/org/apache/iotdb/db/queryengine/transformation/datastructure/SerializableBooleanTVListTest.java
delete mode 100644
iotdb-core/datanode/src/test/java/org/apache/iotdb/db/queryengine/transformation/datastructure/SerializableDoubleTVListTest.java
delete mode 100644
iotdb-core/datanode/src/test/java/org/apache/iotdb/db/queryengine/transformation/datastructure/SerializableFloatTVListTest.java
delete mode 100644
iotdb-core/datanode/src/test/java/org/apache/iotdb/db/queryengine/transformation/datastructure/SerializableIntTVListTest.java
delete mode 100644
iotdb-core/datanode/src/test/java/org/apache/iotdb/db/queryengine/transformation/datastructure/SerializableLongTVListTest.java
rename
iotdb-core/datanode/src/test/java/org/apache/iotdb/db/queryengine/transformation/datastructure/{SerializableRowRecordListTest.java
=> SerializableRowListTest.java} (57%)
create mode 100644
iotdb-core/datanode/src/test/java/org/apache/iotdb/db/storageengine/dataregion/compaction/inner/InnerSequenceCompactionSpeedTest.java
create mode 100644
iotdb-core/node-commons/src/assembly/resources/conf/generate_properties.bat
create mode 100644
iotdb-core/node-commons/src/assembly/resources/conf/generate_properties.sh
copy
iotdb-core/node-commons/src/main/java/org/apache/iotdb/commons/client/async/{AsyncConfigNodeIServiceClient.java
=> AsyncConfigNodeInternalServiceClient.java} (83%)
rename
iotdb-core/node-commons/src/main/java/org/apache/iotdb/commons/client/async/{AsyncConfigNodeIServiceClient.java
=> AsyncDataNodeExternalServiceClient.java} (75%)
copy
iotdb-core/{consensus/src/main/java/org/apache/iotdb/consensus/iot/client/AsyncIoTConsensusServiceClient.java
=>
node-commons/src/main/java/org/apache/iotdb/commons/client/async/AsyncPipeConsensusServiceClient.java}
(67%)
create mode 100644
iotdb-core/node-commons/src/main/java/org/apache/iotdb/commons/client/container/PipeConsensusClientMgrContainer.java
create mode 100644
iotdb-core/node-commons/src/main/java/org/apache/iotdb/commons/client/property/PipeConsensusClientProperty.java
create mode 100644
iotdb-core/node-commons/src/main/java/org/apache/iotdb/commons/client/request/AsyncRequestContext.java
create mode 100644
iotdb-core/node-commons/src/main/java/org/apache/iotdb/commons/client/request/AsyncRequestManager.java
rename
iotdb-core/{confignode/src/main/java/org/apache/iotdb/confignode/client/async/handlers/rpc/AbstractAsyncRPCHandler.java
=>
node-commons/src/main/java/org/apache/iotdb/commons/client/request/AsyncRequestRPCHandler.java}
(56%)
create mode 100644
iotdb-core/node-commons/src/main/java/org/apache/iotdb/commons/client/request/ConfigNodeInternalServiceAsyncRequestManager.java
create mode 100644
iotdb-core/node-commons/src/main/java/org/apache/iotdb/commons/client/request/DataNodeInternalServiceRequestManager.java
create mode 100644
iotdb-core/node-commons/src/main/java/org/apache/iotdb/commons/client/request/Utils.java
create mode 100644
iotdb-core/node-commons/src/main/java/org/apache/iotdb/commons/client/sync/SyncPipeConsensusServiceClient.java
delete mode 100644
iotdb-core/node-commons/src/main/java/org/apache/iotdb/commons/conf/ConfigFileAutoUpdateTool.java
create mode 100644
iotdb-core/node-commons/src/main/java/org/apache/iotdb/commons/conf/ConfigurationFileUtils.java
copy
iotdb-core/{datanode/src/main/java/org/apache/iotdb/db/pipe/execution/PipeConnectorSubtaskExecutor.java
=>
node-commons/src/main/java/org/apache/iotdb/commons/enums/PipeRemainingTimeRateAverageTime.java}
(52%)
copy iotdb-api/pipe-api/src/main/java/org/apache/iotdb/pipe/api/type/Type.java
=>
iotdb-core/node-commons/src/main/java/org/apache/iotdb/commons/pipe/connector/compressor/PipeCompressorConfig.java
(61%)
copy
iotdb-client/service-rpc/src/main/java/org/apache/iotdb/rpc/subscription/payload/poll/SubscriptionPollResponseType.java
=>
iotdb-core/node-commons/src/main/java/org/apache/iotdb/commons/pipe/connector/payload/pipeconsensus/request/PipeConsensusRequestType.java
(52%)
copy
iotdb-core/{confignode/src/main/java/org/apache/iotdb/confignode/client/ConfigNodeRequestType.java
=>
node-commons/src/main/java/org/apache/iotdb/commons/pipe/connector/payload/pipeconsensus/request/PipeConsensusRequestVersion.java}
(72%)
create mode 100644
iotdb-core/node-commons/src/main/java/org/apache/iotdb/commons/pipe/connector/payload/pipeconsensus/request/PipeConsensusTransferFilePieceReq.java
create mode 100644
iotdb-core/node-commons/src/main/java/org/apache/iotdb/commons/pipe/connector/payload/pipeconsensus/request/PipeConsensusTransferFileSealReq.java
create mode 100644
iotdb-core/node-commons/src/main/java/org/apache/iotdb/commons/pipe/connector/payload/pipeconsensus/request/PipeConsensusTransferFileSealWithModReq.java
create mode 100644
iotdb-core/node-commons/src/main/java/org/apache/iotdb/commons/pipe/connector/payload/pipeconsensus/response/PipeConsensusTransferFilePieceResp.java
create mode 100644
iotdb-core/node-commons/src/main/java/org/apache/iotdb/commons/pipe/metric/PipeRemainingOperator.java
copy iotdb-api/pipe-api/src/main/java/org/apache/iotdb/pipe/api/type/Type.java
=>
iotdb-core/node-commons/src/main/java/org/apache/iotdb/commons/pipe/plugin/builtin/connector/iotdb/consensus/PipeConsensusAsyncConnector.java
(58%)
copy iotdb-api/pipe-api/src/main/java/org/apache/iotdb/pipe/api/type/Type.java
=>
iotdb-core/node-commons/src/main/java/org/apache/iotdb/commons/pipe/plugin/builtin/processor/pipeconsensus/PipeConsensusProcessor.java
(58%)
delete mode 100644
iotdb-core/node-commons/src/main/java/org/apache/iotdb/commons/pipe/task/DecoratingLock.java
rename
iotdb-core/{confignode/src/main/java/org/apache/iotdb/confignode/client/ConfigNodeRequestType.java
=>
node-commons/src/main/java/org/apache/iotdb/commons/utils/function/CheckedTriConsumer.java}
(74%)
create mode 100644
iotdb-protocol/thrift-consensus/src/main/thrift/pipeconsensus.thrift
