This is an automated email from the ASF dual-hosted git repository.
Caideyipi pushed a change to branch sync_from_iotdb_dev/1.3_20260616
in repository https://gitbox.apache.org/repos/asf/iotdb.git
was 578c5036b4a Pipe: avoid blocking startup on hardlink dir cleanup
(#17932) (#17943)
This change permanently discards the following revisions:
discard 578c5036b4a Pipe: avoid blocking startup on hardlink dir cleanup
(#17932) (#17943)
discard e943f9c96a5 [To dev/1.3] Fix driver scheduler ready queue reservation
leak (#17920)
discard cb3c927fbc0 [To dev/1.3] refactor client-cpp (#17803)
discard b76b9c72c47 [to dev/1.3] Fix tree model WAL serialized sizes (#17886)
discard 16766b4870d Fix Windows path segment validation (#17868) (#17888)
discard 51039e4314a Optimize pipe event batching and listener stop (#17864)
(#17885)
discard d00c681bc13 Optimize load partition routing (#17863) (#17884)
discard f29c415bef2 Support sink config key for pipe request slicing (#17858)
(#17883)
discard feb016d4747 Optimize local load TsFile piece dispatch (#17851) (#17876)
discard 27fceae8e9e Fix pipe receiver type conversion load path (#17849)
(#17873)
discard 7b87fea4424 [to dev/1.3] Pipe: backport auto split fixes (#17866)
discard 83a924ca832 Fix PBTree schema cache release after pre-delete (#17834)
(#17852)
discard a29e2742570 [to dev/1.3] Fix count and show timeseries follow-up
(#17837)
discard c07709066c3 Fix pipe permission retry and table parser progress
(#17844) (#17848)
discard 041f949728f Fix flaky stamped lock test (#17832) (#17839)
discard 93cac161b34 Fix operator tests for transient null TsBlocks (#17838)
(#17847)
discard 132b119f3e9 Optimize InsertTabletStatement tablet conversion (#17805)
(#17842)
discard ff76cc83cde Fix pipe tsfile receiver database handling (#17815)
(#17836)
discard 8c2fc7e2424 Fixed UDF jar metadata handling in `UDFInfo` when multiple
UDFs share the same jar (#17732) (#17835)
discard 270f5148087 [to dev/1.3] Pipe: account page decode memory in scan
parser (#17807) (#17833)
discard 7a51a1c396f Ratis CI: Fixed the ratis CI port clash & Optimized the
logs to avoid printing JVM crash (#17675) (#17830)
discard 3d3ffcef531 Pipe IT: Stabilize tree model leader stop test (#17825)
discard 311c6b08acf Fix flaky space quota IT (#17812) (#17824)
discard 6b69c2a1a92 [to dev/1.3] C++ client: backport thread-safe SessionPool
(#17800) (#17817)
discard 624059b6132 Reapply "Fix CQ recovery gap and stale callback
contamination (#17734) (#17820)" (#17826) (#17829)
discard fd2f9f59977 Optimized the overall performance of IoTDB & Fixed the NPE
in LimitOperatorTest (#17664) (#17819)
discard 053a5228afc Fix CQ recovery gap and stale callback contamination
(#17734) (#17820)
discard fb8449d9f1b Pipe: Fixed the bug that drop pipe may stuck when
disruptor is interrupted or ring buffer full (#17673) (#17818)
discard 92673ca13ac Added flags to mark whether a device has device
descendants to optimize query like select xx from xxx.** (#17672) (#17802)
discard 2d58d5d74bd Excluded system & audit from COUNT TIMESERIES and included
views (#17703) (#17792)
discard bf8f7a99402 [dev/1.3] Pipe: Harden legacy pipe file transfer
validation and access checks (#17791)
discard dd955b41f11 Load: Stablized the IoTDBLoadTsFileWithModIT (#17787)
discard 2ee1b8bda4e [To dev/1.3] Pipe Log: Reduce repeatable logs (#17700)
(#17793)
discard 412b1477807 Pipe: Removed the useless ban on async file transfer for
non realtime-first pipes (#17785)
discard b1175bfbdb1 [To dev/1.3] Fix pipe drop event discard with
restart-aware committer keys (#17748) (#17778)
discard c832008f690 Degraded the UT logs (#17782)
discard 5389c3fb087 fix(client-cpp): ignore 0.0.0.0 in write redirection
discard fd1b3dbbc80 [To dev/1.3] [Pipe] Optimize memory usage (#17775)
discard e3015b59584 Fixed TTL problems (#17735) (#17758)
discard eb9fbc7f6b3 Pipe: Stablized the tree model IoTDBPipeClusterIT (#17729)
(#17762)
discard 1d93c045921 [To dev/1.3] Add historical transfer summary logs (#17763)
discard c6849079356 Pipe: Do not listen to tsFiles when no sources need
(#17669) (#17761)
discard d4ea95e77f1 Upgrade Netty for CVE fixes (#17760)
discard a3dac0c567f Pipe: Implemented batch logic for air-gap sink (#17667)
(#17727)
discard 37a27bb6c6c Fix fast last empty cache handling in 1.3 (#17743)
discard 8bb1515a181 [To dev/1.3] Make IoTDBLastQueryAliasITs query ordered
discard b8db6c2cb50 [To dev/1.3] Fix forced Exchange branch isolation in
distributed align-by-device planning
discard ef11d02b7b5 Pipe: Optimized logger for temporarily out of memory
exception & Do not stop pipe for "Waited for memory to parse TsFile" (#17542)
(#17728)
discard 009d1bed9fe [to dev/1.3] Fix query reuse of flushing memtable TVList
(#17709)
discard 859930708d9 [To dev/1.3] Pipe: Fixed multiple leakages of
InsertNodeMemoryEstimator (#17657) (#17685)
discard f283164a7ae Pipe: Implemented slice logic for async sink (#17668)
(#17679)
discard c3dd27a08b3 Pipe: Do not wait for sealed tsFiles close at realtime
(#17671) (#17681)
discard de2f375e3b5 [To dev/1.3] Fixed the bug that the unclosed file may be
degraded when directly deleted (#17024) (#17660)
discard df987709c7a [to dev/1.3] Fixed concurrency issues caused by write and
flush sorting during query execution
discard 4c7c477bb4a [To dev/1.3] Pipe: Fixed the OOM bug of parser for large
aligned pages (#17639) (#17646)
discard 4d0945c2990 [To dev/1.3] Load: Harden LOAD TSFILE source path
validation (#17624) (#17654)
discard 539e6a61741 Pipe: Optimized the thread executor of the terminate event
(#17638) (#17647)
discard ada8049a4fd [to dev/1.3] Fix nested ColumnTransformer close
discard 06dc1ba7225 [To dev/1.3] Fix that WALBuffer waits for flush instead of
file-roll (#17628) (#17633)
discard 5cc98215002 [To dev/1.3] Fixed multiple bugs of insertion (#17570)
(#17608)
discard cbb80d79927 [To dev/1.3] Pipe: Fixed the first-chunk calculation bug
for scan parser (#17597) (#17622)
discard 9c82970e72d [To dev/1.3] Load: Fixed multiple bugs (#17565) (#17623)
discard bb10b3b05d2 [To dev/1.3] Pipe: Fixed the event clear logic of drop
pipe (#17560) (#17619)
discard 6cd9f4bf0b9 Fixed the print-tsfile.sh to avoid wrong IOTDB_HOME
(#17596) (#17621)
discard eccccce1c41 [To dev/1.3] Pipe: Implemented skipReportOnCommit for
PipeRealtimeEvent to avoid premature report for unordered flush (#17561)
(#17620)
discard 8194605070f [To dev/1.3] Clean up dead RPC thread config and use
node-specific selectorNum (#17618)
discard e518c773fe5 [To dev/1.3] Fix NPE because of thread of DriverScheduler
was not closed immediately when stop DN
discard 8f2be5fc2be [To dev/1.3] Refuse unreasonable string length in thrift
frame
discard edf6f29e5d6 Subscription: Fixed multiple bugs (#17563) (#17599)
discard 6fe8590d0e3 [To dev/1.3] Pipe: Reset tablet
pipeDataStructureTabletSizeInBytes to 16MB & Enable stopping exception restart
by manual stop pipe (#17588) (#17604)
discard 189ef2b8e0e Pipe: Fixed the potential leak file handle at the receiver
(#17589) (#17606)
discard 5d620713d78 Pipe: Fixed the bug that the timeout ms is regarded as s
(#17590) (#17607)
discard 903de11346f Pipe: Fixed the bug that the pipe will restart a pipe
stopped by user but encountered sync failure later (#17586) (#17605)
discard d0ff4bfc709 [To dev/1.3] Optimize the configuration logic of
dn_thrift_max_frame_size (#17603)
discard 9fe34e70c9e Pipe: Fixed the bug that the parent class loader may
wrongly load ext pipe plugins (#17580) (#17600)
discard 5ae4f36cb7f [To dev/1.3] Fixed the updateAndGet side effect in
DeviceCacheEntry and PipeRemainingOperator (#17584) (#17602)
discard 196a065abcc [to dev/1.3] Fixed swallowed exceptions in query execution
discard ecddbc52232 [To dev/1.3] Pipe: Fixed the bug that Disruptor may not
clear the reference & will wait long time after pipe close (#17549) (#17569)
discard a316c8417d1 [To dev/1.3] mon: add diagnose information for
MemoryNotEnoughException (#17579)
discard e42509cbb9d [To dev/1.3] Pipe: Fixed the bug that air gap receiver may
not respond in temporary timeout exception & Optimized the directory check in
receiver & Optimized the configNode pipe logic (#17556) & Optimized the clear
logic of Schema Region (#17553) (#17576)
discard fdbd8cd07b9 [To del/1.3] Fix Percentile, Quantile UDFs and update
Cluster UDF (#17435)
discard afec8327b64 [To dev/1.3] Pipe: Fixed the bug that a realtime only pipe
will not transfer historical data when it is altered to a historical pipe
(#17223) (#17226)
discard 83dd1043eb8 [To dev/1.3] Fixed multiple bugs related to schema
(#17405) (#17420)
discard 91f69728db5 [To dev/1.3] Fixed the bug that session cannot query minus
value when only pass paths (#17390)
discard eb6543ef20b [To dev/1.3] Pipe: Fixed the failed logic for compressing
progressReportEvent (#17457) (#17557)
discard fcd9c4fa0ac [To dev/1.3] Subscription: support encrypted password auth
in consumer builder (#17552)
discard 313774957bf Pipe: Optimized the shrink/expand method of blocks (#17555)
discard 2d21dbdfdb0 Fix duplicate deletion emission in TsFileSplitter (#17538)
discard bf2ccec734d [To dev/1.3] Fixed the sequence of limit & offset in
show-devices
discard c2b28a2cbab [To dev/1.3] Fix appearance of dispatching FI failed
because of thrift frame is oversize (#17550)
discard 08119040668 fix: catch exception during TVList ownership transfer to
avoid memory leak
discard 83ab4237f3e fix (#17533)
discard ca3217b0de5 [to dev/1.3] fix AbstractEnv.ensureNodeStatus & Fix: send
set configuration only to target nodes and harden compaction schedule
interruption handling (#17447)
discard dd35474df47 [To dev/1.3] Enable show queries to be executed
immediately when the available memory in the memoryPool is insufficient (#17529)
discard 25d68072a06 [To dev/1.3] Pipe: Upgraded bouncy castle && Added logs
for pipe tsFile parser (#17504) (#17523)
discard aef93cb1299 [To dev/1.3] Pipe: Rewrote the OPC UA subscription logic
to avoid the bug of third-party subscription model (#17524)
discard a069cc9ca67 [To dev/1.3] Load balance patch (#17463) (#17493) (#17527)
discard 2fd023792a4 [To dev/1.3] enhance cppclient tsblock deserialize
validation (#17464) (#17518)
discard 536dae7db73 Pipe: Fixed the OPC UA bug that drop pipe may not erase
the client (#17510) (#17522)
discard efc6238de9f Pipe: Downgraded and reduced the log of
PipePushMetaRPCHandler (#17492) (#17519)
discard d6c04fbcbf3 [To dev/1.3] Enhance the last query permission && Fixed
the rollback version of alter view / table plans && Deleted the unnecessary
mods in Tree view deletion (#17465) (#17494)
discard 3e126d937a5 [To dev/1.3] Pipe: check file receiver write path (#17442)
(#17501)
discard 3ad255972b7 [To dev/1.3] Improve state type validation in
CombineRequest deserialization. (#17449) (#17502)
discard 0f02d829f2a Pipe: Refactor AirGap receiver with configurable payload
size control (#17443) (#17503)
discard a428868c624 [To dev/1.3] Subscription: add removeUserData for messages
(#17479)
discard 70cc776e05b [To dev/1.3] Pipe: Optimized the memory occupation of pipe
realtime source (#17450)(#17474) (#17486)
discard 4141eb92ae5 [To dev/1.3] Subscription: Fixed the retry bug of
procedures & Pipe: Deleted some useless codes (#17455) (#17484)
discard aa9c481006a [To dev/1.3] Pipe: Fixed the OOM bug of tablet memory
calculation & Optimized the tablet size by memory estimation (#17451)
discard 9fc8f9cdca3 [to dev/1.3] fix: prevent NPE when isFinished() is called
before DataDriver init (#17441)
discard de39ebaf921 [To dev/1.3] Fix the deadlock at ConfigNode
PipeTaskCoordinatorLock (#17233) (#17424)
discard 56f387bca5d Load: Fixed multiple bugs (#17413) (#17421)
discard ab664ed7ea1 Subscription: Fixed multiple problems (#17418) (#17422)
discard 967c54f52fb [To dev/1.3] Pipe: Cleaned multiple potential problems in
pipe module (#17396) (#17417)
discard bb3f11804a1 [To dev/1.3] Pipe: Fixed some potential OPC UA problems
(#17393) & Added IT for `` in opc (#17394)
discard 7f8ded1ce65 [To dev/1.3] Remove OpenID authorizer and related
dependencies (#17406)
discard 3af64ddd6e4 [TIMECHODB][To dev/1.3] Actively disconnect inactive
connections
discard d8446d4ff7e [To dev/1.3] cpp session query timeout (#17403)
discard 6aa83fc3fa9 [To dev/1.3] Add result size limit and time slice control
for TransformOperator (#17402)
discard 657aa8eb294 [To dev/1.3] Clean up tmp dirs of udf and sort while
starting up (#17377)
discard fb5ca868511 Pipe: Implemented OPC Sink for outer server & Set
configuration and changed the default value of the server security policies &
Made the default quality configurable and does not throw when non-value/quality
measurement is encountered (#16944) (#17367)
discard f0bd4c4b837 [To dev/1.3] Fix kill query doesn't take effect bug
(#17358)
discard 0222945e3ce [TIMECHODB] Fix dependency version
discard bd4f2e1fc09 [TIMECHODB] Fix dependency version
discard 3713a365b2a [To dev/1.3] Pipe: Fixed the on committed hook square bug
& Trimmed the raw tablet hook & Fixed the premature report for source event &
Skipped the parsing of time-covered tsFile (#17360) (#17362)
discard f123f1c0b69 [To dev/1.3] Fixed the default string charset in CI
(#17357)
discard 1fab4996a67 [To dev/1.3] Pipe: Fixed the log of disruptor queue &
deleted the useless binary buffer (#17341) (#17359)
discard dedf0ba0e99 [To dev/1.3] Add extra client_ip and timeout columns for
show queries
discard b5543371f96 [To dev/1.3] Fixed the REST partial insert & Pipe: Added
partial insert IT (#17339)
discard fb768be2cfe Remove IoTDBOrderByForDebugIT. #17351
discard 96d2b24929b [To dev/1.3] Subscription: split client and example
modules (#17326)
discard 44184686b5f [To dev/1.3] Pipe: Added robustness to OPC UA measurement
logic (#17325)
discard 1680f55032d Remove extra user caching for REST services and migrate to
the unified user check cache. (#17324)
discard 3fba523432d feat(subscription): support consumer timeout and idle
disconnect (#17300)
discard 615e961f493 [To dev/1.3] Pipe: Use async launch to avoid blocking
datanode start (#17316)
discard 20cfe168fc7 [To dev/1.3] Subscription: refactor payload APIs to use
ResultSet and tsfile readers (#17307)
discard accdd5fcae4 [To dev/1.3] Deleted the useless device flush map & Pipe:
Made the assigner cache to full cache & Use precise match in assigner device &
Print periodical log when assigner has exceeded half of the capacity (#17313)
discard 736899b01dd [To dev/1.3] Pipe: Optimized the OPC UA logic to avoid
potential bugs (#17310)
discard 36b6a7913e9 [To dev/1.3] Pipe: Fixed the crashed VM for ITs & Added
watcher thread for dataNode start (#17281) (#17282)
discard f43545cf63d [to dev/1.3] Fix incorrect early termination in descending
scan of unpackOneFakeMemChunkMetaData
discard a5eb817f70e Fixed that InsertionCompactionSelection may skip a file
deleted by another compaction (#17254) (#17259)
discard f0a6535222f [To dev/1.3] Pipe: Fixed the bug that the default
"enable-send-tsfile-limit" is set to false for historical pipes split by full
sync (#17264) (#17265)
discard 3cb03b5b2e2 Pipe: Configured the air gap timeout to avoid packet loss
(#17231) (#17253)
discard 3f5e15fb200 [To dev/1.3] Pipe: Optimized the error code of illegal
pipe / pipe plugin name string (#17206)
discard 292b73ec436 [To dev/1.3] Fix race condition in SharedTsBlockQueue
async listener causing NPE in MemoryPool.free() (#17196) (#17204)
discard 30a49d97256 [To dev/1.3] Fix ddl overflow bug
discard 1c8ae2c159f Pipe: Enabled retry locally for air gap receiver &
temporary unavailable exception (#17188) (#17199)
discard 7a3742d5285 [To dev/1.3] Retry dispatch failed local write FI remotely
(#17187)
discard 73a03e11b87 [To dev/1.3] Pipe: Enabled locally retry for
PipeConnectionException (#17182) (#17190)
discard 1271e5ae171 [To dev/1.3] Pipe: Reduced the downgraded epochs'
downgrading limit to reduce the latency (#17184) (#17189)
discard ac3392ca95b Pipe: Fixed the idempotent semantic for MULTIPLE_ERROR
(#17177) (#17185)
discard 7827c0d5a65 Pipe: Changed the separator check semantic for pipes /
pipe plugins (#17175) (#17183)
discard de838cc3658 Ignore non-tsfile when importing tsfile (#17173)
discard eca9cfc89d7 [To dev/1.3] Pipe: Optimized the logger semantic && the
retry logic of memory error at sink subtask (#17166) (#17174)
discard e8bc5be5415 Fix data export logic in IoTDB-1.3 to avoid redundant high
frequency query (#17076)
discard 04457c4ce3a [To dev/1.3] Pipe: Fix IT (#17168)
discard 8490f9c020e [To dev/1.3] Pipe: Fixed the legacy sink IT (#17164)
(#17165)
discard 2343598e871 [To dev/1.3] Fixed the bug that the template may create
measurements under timeSeries && Optimized the logger for meta user exceptions
#17158 (#17160)
discard dc199037f85 Fixed the NPE when validating legacy sink (#17153) (#17161)
discard e29b39f6abc [To dev/1.3] Pipe: Banned the illegal names in pipe and
pipe plugins (#17145) (#17156)
discard 498bffec1a8 Fix delete NPE after insert failed (#17122) (#17125)
discard 01f8d527d10 [To dev/1.3] Fixed the potential NPE of schema quota
(#17140) (#17151)
discard f807acdfa59 [To dev/1.3] Fix sort branch release logic of SORT
operator #17149
discard 6066189bd9b [TIMECHODB][To dev/1.3]Fix warnings in mqtt-batch-write.
discard cfb54fec7f4 [To dev/1.3]Security fix: Bump Jetty to 9.4.58.v20250814
(CVE-2025-5115) (#17137)
discard 4e295da271c [To dev/1.3] Optimized the performance of subscription
(#17115) (#17121) (#17135)
discard 58ddaf7e119 [To dev/1.3][Bug fix] The partition table is cleaned
incorrectly when set only device TTL for tree mode (#17123) (#17126)
discard 5b21134abd4 [to dev/1.3] TimeFilter.canSkip() use getStatistics()
method (#17120)
discard 510b04318d9 [To dev/1.3] Fix timeseries alias display in last for
TreeModel #17117
discard d084b92d755 [to dev/1.3] Fix allValueColDeletedMap index out of bound
caused by stale rowCount after TVList sort #17103
discard f56d4f87ad6 [TIMECHODB][To dev/1.3]Modify the batchWriteUtils's
handling logic for tsstatus=400.
discard e4ecd83430d [To dev/1.3] Remove built-in jexl function in tree mode
(#17095)
discard 2b5b0e96084 [To dev/1.3] Delete unused and vulnerable rpc interface
(#16603) #17097
discard a5ab84235c3 [To dev/1.3] Change all query example into iterator style
(#16187)
discard 8b6900f0803 [TIMECHODB] fix it
discard 7de94f205df [to dev/1.3] add IT for last query #17075
discard c745c4e5509 [TIMECHODB][TIMECHODB][To dev/1.3] Remove AINode CI
discard 9f56f37e83b [to dev/1.3] fix last query bug #17072
discard 8ca8c4ccd52 Change default dn rpc address (#17060) (#17068)
discard 5fb1a8f14d2 [To dev/1.3] Pipe: support pattern pruning and redundancy
removal in TreePattern parsing (#17059)
discard 167fa4c8a57 [To dev/1.3] Pipe: disable multiple path and path
exclusion (#17051)
discard f12c3e472d2 Pipe: Trimmed the unnecessary device getting for
historical tsFiles (#17036) (#17050)
discard 6aa119fbf4d [To dev/1.3] Pipe: Fixed the semantic of reporting
interval && Trimmed the "toString" of InsertMultiTabletsStatement (#17044)
(#17052)
discard ebdfd2ebbac [TIMECHODB][TIMECHODB] update .gitlab-ci.yml before_script
add clean \u0000 files
discard 03704e7526d [TIMECHODB][TIMECHODB][To dev/1.3] Add metrics and sync
logic to async batch utils
discard 39eb7ee3d68 [TIMECHODB]Add Moquette monitoring metrics.
discard db1388d0f12 [To dev/1.3] Fix query error after insert an all null
aligned tablet and flush (#17041)
discard 7e87cf144e9 [to dev/1.3] Optimize
DeviceViewIntoOperator.findWritten(String device, String measurement) #17007
discard 1793d1e8100 [To dev/1.3] Ignore the pipe plugin failure when starting
a DataNode (#17000)
discard 428be9898ba Pipe: Reduced the log of processor memory control (#16989)
(#16996)
discard 7f67474a58f Pipe: Refactored the PipeTaskCoordinatorLock (#16988)
(#16997)
discard 51c8ae9c3d1 [to dev/1.3] Fix incorrect overlap unpack when endTime
equals sentinel value #16993
discard 5dce7098a43 [To dev/1.3] Optimized the error log for schema execution
(#16982) (#16986)
discard 55de5591ba7 [To dev/1.3] Improve DeviceViewIntoOperator's return style
to pipeline (#16980)
discard 196ed5aed6f [To dev/1.3] Implemented minor fix of pipe IT (#16981)
discard 126698aa4ad [to dev/1.3] Further optimize the efficiency of memtable
region scan #16979
discard cff545b0501 [TIMECHODB][To dev/1.3][TIMECHODB] fix AsyncBatchUtils for
dev
discard e0eb4982006 [TIMECHODB][To dev/1.3] Add mqtt batch insert logic.
discard 9db028345b4 Disabled the repeatable pipe log when the receiver is down
(#16963) (#16974)
discard 3ddc572a386 Pipe: Fixed the bug that batch memory is not visible to
pipe memory management (#16962) (#16973)
discard 3b86fafc42f [to dev/1.3] fix mem table query bug (#16970)
discard 9946e58d515 fix: reserve memory for sorting indices during query
execution (#16959)
discard 873536289cf Fix memory leak when allocation failure in IoTConsensus
queue (#16966)
discard fe0e28b39ca [to dev/1.3] fix LastQueryScanNode sort #16956
discard 4a4a11d87eb [TIMECHODB] Add AsyncBatchUtils for batched write reqs
discard 9e24737553d fix: synchronized method in
ThreadSafeMemoryReservationManager #16950
discard 3955222b232 fix: PR16943 type error (#16948)
discard bde062b7e94 [To dev/1.3] Pipe: Implemented the
processTabletWithCollect api with tablet collector (#16941)
discard 3055ef2feda [To dev/1.3] Bump version to 1.3.7-SNAPSHOT (#16947)
discard be0f1d99a3e [To dev/1.3] fix: memory to be released is larger than the
memory of memory block in TVList owner transfer case #16943 Open
discard bb138be21a9 [To dev/1.3] Load: Add check for reset memory size to 0 in
LoadTsFileMemoryManager (#16940) #16942
discard f68e002e9e8 [To dev/1.3] Cherry-pick some CVE fixes (#16901)
discard 660dbba60cb [To dev/1.3] Active Load: Add cleanup for active load
listening directories on DataNode first startup (#16854) (#16866)
discard 784306756b0 [To dev/1.3] Load: Fix excessive GC caused by loading too
many TsFiles at once (#16853) (#16867)
discard 8ec7895a6e9 [to dev/1.3] Optimize memtable region scan #16891
discard 07a9b2ebe1b Removed the useless first key in schema cache (#16881)
discard be18578f9e5 Pipe: Fix NullPointerException in concurrent event access
(#16849) (#16872)
discard 1b0a5843618 [To dev/1.3] PipePlugin: Optimized the errorCode && Fixed
the case-sensitive semantic (#16851) (#16852)
discard b63e66779c7 [To dev/1.3] Pipe: Fixed the auth judgement NPE & Reduced
the log in InsertTabletStatement (#16859) (#16863)
discard ca52f63b18e [To dev/1.3] Pipe: Prevent duplicate error logging in
AsyncPipeDataTransferServiceClient (#16856) (#16857)
discard f0b783b2476 [to dev/1.3] Fix NPE during compaction when disk space is
insufficient (#16842)
discard b2923c84d83 [To dev/1.3] Pipe: Fixed the bug that sender tablet may
cause NPE & The temporary exception may be wrongly reported (#16843) (#16848)
discard 26a32eb7a9e [To dev/1.3] Fixed the schema cache calculation 2 & The
potential NPE caused by concurrent invalidate and update (#16834) & The schema
cache is not cleared for "clear schema cache" (#16833)
discard 97c1ae009e1 Pipe: Ignore logging when `returnSelf` is called in the
event of an exception in `AsyncClient`. (#16828)
discard 3507e46c59c Reduced the auth log when paths are too many (#16825)
(#16830)
discard 822ba96554a [TIMECHODB][TIMECHODB][To dev/1.3][Bug Fix] Cannot use
‘ACTIVATE’ to activate
discard f79ef2dd550 [TIMECHODB] fix var name
discard 8b27164cb08 [To dev/1.3] Fixed the concurrency issue of region migrate
and load (#16796) (#16823)
discard e9f405490d4 [To dev/1.3] Cherry-pick some IoTConsensus related commits
to 1.3 (#16812)
discard 997e5e0d29c Fixed the calculation error of schema cache (#16818)
(#16822)
discard 81963fc356c Pipe: Fixed the bug of missing parallel conflict check and
receiver log (#16814) (#16820)
discard ba15ef453eb [To dev/1.3] Pipe: Fixed the check for no permission 2
(#16804) (#16815)
discard 858ff313f47 Add a judgment in order to avoid occur NPE when one value
of measurementSchemas is null (#15574) (#16813)
discard 35179b71974 Pipe: Adjusted the waiting time of temporary unavailable
exceptions (#16798) (#16805)
discard c1d50b988f2 [To dev/1.3] Cherry pick session connection leak fixes
(#16808)
discard e30a2386816 [To dev/1.3] Update ratis-thirdparty-misc.version to
1.0.10 (#16810)
discard 361930d54bb Avoid connection reset error log printed (#16797) (#16802)
discard 7aa6a66cb95 Bump ratis version to 3.2.1 (#16800)
discard 9898726d25f [To dev/1.3] Load : Fixed parameter passing error in
MoveFile function (#16748) (#16792)
discard e077c871c84 [To dev/1.3] Load: Remove the getParentFile and exists
checks from Load New File (#16787)
discard 2d0d1e68cb8 [To dev/1.3] Load: Fixed the issue of TSFile parent
directory being null and TSFile resource being updated during the Load process.
(#16751) (#16790)
discard 8fd43840702 [To dev/1.3] Fixed the bugs related to device auto-create
alignment ignorance (#16780) (#16782)
discard ec5f5657311 [to dev/1.3] Fix slow query threshold & fix a bug for
lastQuery & optimize encodeBatch for multi tvlist scene (#16766)
discard 927ef6112af [To dev/1.3] Pipe IT: always throw exception with failure
when executing non-queries & Fixed some semantic errors of IT (#16331) (#16771)
discard 236d64a51bd [TIMECHODB][TIMECHODB] [To dev/1.3] fix load with object
storage error and fix compaction tier error
discard f839d21c0e3 [To dev/1.3] Load: Fixed the bug that mods is not deleted
in load tsFile when there are exceptions & Fixed the potential NPE in air gap
agent close() method #16775 (#16776)
discard 64938a68db6 Set the parameter names from default_storage_group_level
to default_database_level (#16626) (#16646)
discard 4931c8eab75 [To dev/1.3] Pipe: Modify the Pipe configuration item log
name to be consistent with the Properties name. (#16732) (#16759)
discard f60c8ac1176 fix (#16702) (#16772)
discard ec0cc6e9f08 [to dev/1.3] reduce error log when compaction service is
stopped & fix bugs (#16755)
discard 93241ff4ea9 [To dev/1.3] Pipe: support path exclusion under tree model
(#16632) (#16763)
discard 14767acc0fa setup (#16752)
discard 0edf0c80349 [To dev/1.3] Active Load: Fixes errors caused by Load
copying resource files. (#16753) (#16757)
discard 3c4665ba06c [To dev/1.3] feat: encode load attributes in active load
directories (#16722) (#16758)
discard a24b26633af [To dev/1.3] Pipe: Trimmed some of the pipe logs (#16747)
(#16754)
discard e10eb9e0a9c [To dev/1.3] Load: Fixed parameter passing error in
MoveFile function (#16748) (#16749)
discard 6902a813668 Load: Fix the Session exit issue after type conversion
(#16037) (#16743)
discard 2887f0429a0 Pipe: Optimized the default behavior in meta sync for
retries to wait for other regions (#16740) (#16746)
discard 1cd2cc2edc9 Fixed the NPE caused by concurrent "check for
createTimeSeries" and deleteTimeSeries (#16742) (#16745)
discard 174c09e5645 chore!: Bind real config address for Thrift and Raft
services (#16717) (#16730)
discard af70244f058 Pipe: Fix unhandled timeout exceptions in Thrift Client
(#16727) (#16731)
discard 902bbb94c70 [TIMECHODB] update pom.xml, use timecho nexus
discard 315622fdcea [To dev/1.3] Make ErrMsg more readable when the predicate
has too many conjunctions because of too many devices #16716
discard 8a50c287cb9 Fixed unprocessed column writes in Last Cache update
(#16728)
discard 3b67b5346c2 [To dev/1.3] Active Load: Ignore
java.io.UncheckedIOException exceptions thrown during the file scanning
process. (#16705) (#16726)
discard ce575fff855 [To dev/1.3] Pipe: Fixed the NPE of commit interval
(#16714) (#16723)
discard 11e8bab2305 [To dev/1.3] Fixed the null error message of fetch schema
failed when the regions is removing (#16713) (#16718)
discard bee75dca26a [To dev/1.3][remove datanode] cherry pick related commits
(#16711)
discard aa59cfd4e8f [To dev/1.3] Load: Fixed an issue where premature
persistence of TSFileResource caused incorrect configuration to be not saved
(#16703)
discard 3f5509ba252 [To dev/1.3] SeriesScanUtil throws exception when using
filters that could not match any time range (#16692)
discard ce0d63c8c90 [To dev/1.3] Fix process logic of empty TsBlock in
InputLayer of TransformOperator (#16678) (#16679)
discard e7b49f3db2b [To dev/1.3] Pipe: Add metrics for TsFile parsing to
tablets (#16668) (#16673)
discard 32a15a8f155 [TIMECHODB][TIMECHODB] Bump netty version to 4.1.126.Final
discard 26575a03201 [To dev/1.3] Optimize the efficiency of DualKeyCacheImpl's
mayEvict (#16445) (#16669)
discard a0a9a85d958 [to dev/1.3] Optimize memtable scan
discard 1c704ca013f [To dev/1.3] Pipe: Add TsFile parsing with Mods function
(#16540) (#16651)
discard 2e13b4f5002 [To dev/1.3] Pipe: Added log control for pipe receiver
auth exception (#16659) (#16660)
discard e44db6e515b [To dev/1.3] Made the schemaRegionMap nonnull for
SchemaEngine (#15775) (#15777)
discard 98b8178e158 [To dev/1.3] Add HashLedaerBalancer (#16654)
discard 4a04e28683e [To dev/1.3] Pipe: Fixed the potential NPE in receiver
tablet construction (#16648) (#16656)
discard 99cf0bc40bb [To dev/1.3] Fix aggregation query when device cross
region in TreeModel #16650
discard a3d25ff90d9 [To dev/1.3] Pipe: Fixed the semantics for new regions &
realtime / history only pipes (#16641)
discard aaef380b9c8 [To dev/1.3] Load: Deleted the unnecessary auto-creation
(#16624) (#16628)
discard 9a76f5c53fa [To dev/1.3] Pipe: support multiple path patterns under
tree model (#16575) (#16629)
discard d0acdf71b0c [To dev/1.3] Pipe: Fixed the shouldMarkAsPipeRequest for
CreateTable and AlterLogicalView Sync (#16619) (#16620)
discard 82ba076a579 [To dev/1.3] perf: Optimize the mark bitmap operation of
AlignedTVList InsertTablet (#16199) (#16590)
discard 7cf8b91519c [To dev/1.3] Pipe: Added parameter check to handshake of
legacy receiver (#16596) (#16599)
discard 083ca7d9d85 [To dev/1.3] Pipe: Fixed the bug that the schema may be
sent twice when split-enabled & database may be null for non-first schema pipes
(#16586) (#16589)
discard 449b9c9223e [To dev/1.3] Pipe: Fixed the bug that mark-as-pipe-request
may not be of use in configNode events (#16581) (#16583)
discard 86b8935bfc1 [To dev/1.3] Pipe: Fixed the potential memory shortage may
lead to forever blocking (#16570) (#16574)
discard 12c275702bb [To dev/1.3] Pipe: Cleaned some questionable parameters &
Fixed unstable testPipeAfterDataRegionLeaderStop (#16555) (#16565)
discard c5805401c5d [TIMECHODB][TIMECHODB] Pipe: Optimized tsFile sending speed
discard 78c0c586cb6 [To dev/1.3] Load: Optimized the exception error message
of convertion to tablet (#16499) (#16530)
discard 3da9385e2b0 [To dev/1.3] Ignore device alignment in timeSeries
auto-creation (#16516) (#16517)
discard c84c6fcf5e4 [To dev/1.3] fix: Updated TSFile version to fix Load
failure in creating aligned time series (#16502) (#16500)
discard 012f7a4d3ba [To dev/1.3] Pipe: Reduced the conversion logger & Fixed
the illegal formats of PipeLogger (#16503) (#16505)
discard e9b68024bfb [To dev/1.3] Load: Re-enabled the is aligned exception
check
discard 20653c513bb [To dev/1.3] Fix Metric name
discard c518bb9541a [To dev/1.3] Pipe: Fixed the concurrency bug of stop /
start (#16461) (#16464)
discard dfe3c6c37f9 [To dev/1.3] Subscription: Prevent
IllegalArgumentException in SubscriptionLogStatus by validating bounds for
nextLong (#16447) (#16449)
discard cebc36aaf7a [To dev/1.3] Upgraded the schema cache implementation
(#16425)
discard 93504e5cf50 [To dev/1.3] Create Multi Time Series: Modify logger level
(#16439) (#16440)
discard b687156cdde some tools use getColumnDisplaySize, No exceptions should
be thrown. (#16430)
discard dc109d6f99d [To dev/1.3] Pipe: Further reduced the repeating exception
log & Changed the default log reducer size to 16M & Did some minor fixes in
Device Schema Cache (#16417) (#16423)
discard 00b6bebda69 [To dev/1.3] Pipe: Add Thrift callback processing logic
for ClosedChannelException (#16421) (#16422)
discard 2cd05ada71a Optimize ttl deletion in fast compaction performer
(#16367) (#16383)
discard 720b6f5e283 [TIMECHODB] Change the memory threshold
discard 2df0040f2c1 [To dev/1.3] Pipe: Avoided timeIndexes' memory occupation
for deleted tsFiles && Removed useless stale logic && Improved the memory
calculation of tsFileResource && Avoided the potential failure for permission
check when the source file is deleted (#16399) (#16415)
discard e4ceae8b8b3 [To dev/1.3] Pipe: Avoid throwing null pointer during
Close process (#16391) (#16402)
discard eb5998c499d [To dev/1.3] Pipe: Set placeholder for required
pipeMetaList & Prevented the empty progress report when shutdown (#16388)
(#16396)
discard 90881071904 [To dev/1.3] Pipe: Avoided the OOM risks by replacing the
progressive cheating factor with policy change (#16398) (#16401)
discard 35e1bce2b98 [To dev/1.3] Fixed the potential problem in
DataNodeDevicePathCache & Pipe: Reduced the logs in "PipeReceiverStatusHandler"
(#16397) (#16400)
discard 95b6fd1e840 [To dev/1.3] Update License file (#16395)
discard 222e69758b8 [To dev/1.3] Load: add the function of transferring too
many time partitions of files to tablets and fixed the problem that the data
written to tablets is more than expected. (#16320) (#16321)
discard bd6c12423bf [To dev/1.3] Pipe: Fix unnecessary client shutdown logic
and reduce handshake waiting time (#16341) (#16381)
discard 2efdb5fb2f2 [To dev/1.3] Fix read lock not release when unexpected
exception occurred. #16386
discard 15c046f9f74 [To dev/1.3] Fixed the potential NPE in clear all cache on
local (#16378) (#16382)
discard 51596d2353d [To dev/1.3] Pipe: Fixed the compilation error of 1.3
(#16376)
discard 5c282305961 [To dev/1.3] Pipe: Show "CONFIG_REGION" string instead of
MIN_VALUE in PipeTableResp (#16372) (#16374)
discard 14627e1fe58 [To dev/1.3] Pipe: Fix lost transfer time metric & Support
transfer time tracking for RawTablet events converted from InsertNode/TsFile
events (#16364) (#16370)
discard bd48c3deabe [To dev/1.3] Pipe: Fix epoch status metric (#16355)
(#16366)
discard 5fdfc403f4b [To dev/1.3] Changed the default MQTT handler size to 1/2
number of processors & Fixed some default parameters when core number is 1
(#16363) (#16365)
discard 2ec8dfeeb13 [To dev/1.3] Implemented clear last cache / schema cache
option in clear cache (#16349)
discard adfcc91a08c [To dev/1.3] Fix potential NPE in Unseq List #16360
discard 4cc7e657a13 perf: Adapt to Win11(wmic to powershell and compatibility
adjustment) (#15350) (#16356)
discard 5b6cf220136 [To dev/1.3] Pipe: Restore RPC thread name after Pipe
receiver exit (#16344) (#16345)
discard b1596bb4b1f [to dev/1.3] Page time range set in TVListIterator is not
processed
discard 65643ae0611 [To dev/1.3] Concurrently querying and writing to the
memtable may cause the query results out of order
discard f1b02b72fc9 fixup! Pipe: split full-sync pipe into history and
realtime pipes (#16250) (#16316) (#16317)
discard 94d47b8271e Pipe: Further reduce the pipe logs & Added configurations
for tsFile segment lock (#16315) (#16327)
discard 27aba080e40 [to dev/1.3] Supports streaming load mem chunk & Push down
filter, limit and offset to MemPointIterator
discard 2aed642852c [To dev/1.3] Fix NodeSupplier connection leaky while
encountering exception #16312
discard a8cbe9982f8 [To dev/1.3] Implemented fast last query for on prefix
path (#15810)
discard a66383ff589 [To dev/1.3] Pipe: Modify epoch status metric changes
(#16272) (#16304)
discard 79c818bf194 [To dev/1.3] Pipe: Setup PipeLogger to reduce the selected
pipe logs & Switched some useless logger for pipe in configNode to debug level
(#16296) (#16302)
discard 6d64a8e1e05 [To dev/1.3] Pipe: Optimized the judgement of validation
for start-time and end-time key (#15872)
discard 684f577ae62 [To dev/1.3] Pipe: split full-sync pipe into history and
realtime pipes (#16250) (#16299)
discard 9bd223b907a Load: Switched the logger level to debug when cache memory
temporarily exceeds the max size (#16289)
discard edce4cd53c7 [To dev/1.3] Pipe: Fixed the config meta transfer problem
(#16280) (#16282)
discard b651bd2d0ef [To dev/1.3] Pipe: Fixed the interval manager in general
model (#16268)
discard bae6c36d92b Pipe: Use fixed memory settings to configure batch
(#16134) (#16138)
discard 09eae082e48 [To dev/1.3] Load: Flush ChunkGroup to a temporary file
and cache TableSchema in advance to reduce memory allocation && Add IT test
about Load file across multiple time partitions (#16225) (#16253) (#16273)
discard f0673dcd98f [To dev/1.3] Fix potential NPE in tryGetFLushLock
discard 83888bf1eff Fix NPE in Procedure's log (#16255) (#16278)
discard 122a4875a39 Shuffle data partition allocation strategy (#16260)
(#16279)
discard 9c142d32d77 [To dev/1.3] Pipe: Optimized the path construction
efficiency in pattern match (#16265) (#16271)
discard 0f249dd101f [To dev/1.3] Pipe CI: always flush for
`IoTDBPipeSinkCompressionIT` with batch mode (#16247) (#16269)
discard 157b89120cf [To dev/1.3] Fix error of non-mappable udtf query in align
by device while existing any devices' data cross region
discard 70d4d611ba0 [To dev/1.3] Change Query Data Source init way from lock
to tryLock & Add more log and remove useless synchronize
discard b50f61c8696 [To dev/1.3] Pipe: Fixed the bug that compaction may cause
progressIndex lost (#16258) (#16262)
discard c9c584e7dca [To dev/1.3] Pipe: Switched some unnecessary log to debug
level (#16259)
discard a204f7a662c [To dev/1.3] Pipe: Fixed the NPE caused by multiple errors
(#16118)
discard ba5a16b7360 [To dev/1.3] Region operation "extend" and "remove"
support multi regions in one SQL (#16234)
discard bd07eebfad0 [To dev/1.3] Pipe: Fixed the bug that output.measurements
must be filled when constructing aggregate-processor (#16238) (#16239)
discard 55c757c804d [To dev/1.3] Pipe: Replace fixed aligned series limit with
memory-based estimation to avoid OOM in TsFileParser (#16201) (#16232)
discard 3499f3a895c [To dev/1.3] Make ErrMsg more readable when the predicate
has too many conjunctions because of too many devices (#16224)
discard 0be58e6d810 [To dev/1.3] Fix empty tsfile and resource generated when
insert, load, kill -9 and restart (#16220)
discard 1bf7ee6e9f3 [To dev/1.3] Load: Fixed the memory allocation bug that
may cause more free query memory & Optimized logger for memory not enough
problem (#16206)(#16222)
discard 461d10f56c2 Fix some capitalizations in config template (#16216)
discard bdc25121646 Fix that compression by type is not properly applied
(#16211)
discard fd39c83c924 Add configs to set default compression for each data type
(#16117)
discard 23dd854519d Print measurement for putting buffer exceptions (#15873)
(#16213)
discard 24facb67dac Load: Optimized the partial path split logic in
modifications coverage judgment (#16212)
discard ee9c246edf8 [to dev/1.3] Using PatternTreeMap to cache mod entries in
ReadChunkCompactionPerformer (#16183)
discard 53ce1446e7f [To dev/1.3] Pipe: Optimize TsFile parsing logic (#16173)
(#16207)
discard 00a281e6bb0 [To dev/1.3] Pipe: Comment Config Check (#16194) (#16208)
discard 45d18549516 [To dev/1.3] Pipe CI: always flush for
IoTDBPipeDataSinkIT.testReceiverAutoCreate with batch mode (#16202) (#16204)
discard 47029d8070e [To dev/1.3] Pipe: Optimized the memory usage of progress
report event (#16197) (#16200)
discard 4fe72621a1c [To dev/1.3] Pipe: Changed back the default value of
tsFile batch to 16M (#16174) (#16185)
discard 333fc05a6bf [to dev/1.3] Add memory control for mod entries in query
discard 29c823d7fd9 [To dev/1.3] Use oracle jdk in 1c3d IT (#16182)
discard beeac349ead Fix concurrent modification of non-thread-safe data
structures caused by parallel dispatching
discard 9f503330980 [to dev/1.3] Fix the status code of fetching schema when
memory is not enough
discard ec20738dc0c [To dev/1.3] Fix nodeUrls shuffle error (#16167)
discard 09bc2e5b21a [To dev/1.3] Pipe: Delete unnecessary metrics (#16165)
(#16168)
discard f1347a9017b Replace the key in FileReaderManager to TsFileID
discard 7c7b88595df [To dev/1.3] Pipe: Optimized the commit queue to avoid OOM
problem (#16145) (#16157)
discard 0943dc87960 [To dev/1.3] Pipe: Changed the default periodical login
behavior to disabled (#16162)
discard 20c0d28f378 [To dev/1.3] Pipe: Removed the useless ser-de in receiver
raw req & Improved the handling logic for rowCount and null value bitmaps in
insertTabletNode (#16133)
discard cc0d69d6c46 [To dev/1.3] Load: Fix LoadPieceNode reading aligned Chunk
causing OOM (#16152)
discard 90d55e9de4e [To dev/1.3] Pipe: Use fixed memory settings to configure
batch (#16134) (#16150)
discard 28c31dece5a [To dev/1.3] Load: Reduce unnecessary MD5 calculations
(#16141) (#16151)
discard 02bb79221f7 Skip TTL check when there is no TTL and no mods file in
the data region (#16110) (#16129)
discard 19604b00ac1 [To dev/1.3] Pipe: Avoid unnecessary close-client in async
client (Follow up fix for #16008) (#16136)
discard bace46f20c9 Pipe: Avoid unnecessary close-client in async client
(Follow up fix for #16008)
discard 36eb90f37f7 [To dev/1.3] Temporarily banned some PBTree IT to avoid CI
failure & Pipe: Fixed the client release problem in trackable handler (#16130)
discard 9858f805803 [to dev/1.3] Transfer schema tree in batches & add memory
control for schema tree
discard d89c80afca4 [To dev/1.3] Pipe: Fix and improve async tsfile transfer
error handling and logging (avoid client connection leak) (#16008) (#16125)
discard 00137631f1c [To dev/1.3] Pipe: CN adds logic to check if Pipe is out
of memory #16119 (#16120)
discard 4d1b0785bfb [To dev/1.3] Pipe: Delete the heartbeat event count in
Remaining Count #16115 (#16116)
discard 620abcf9c1e [To dev/1.3] Pipe: Totally banned the receiver conversion
(#16086) (#16105)
discard 717a63b382e [To dev/1.3] Pipe: Do not use the fork join pool in
TerminateEvent #16113 (#16114)
discard d52856a691c [To dev/1.3] Pipe: Fix the stuck state caused by unfair
lock in Sink start phase (#16100) (#16106)
discard c8f8711f8a5 Fix path attack when loading snapshot of IoTConsensus
(#16098)
discard fcf929689c1 [To dev/1.3] Pipe: Fixed TsFile resource leak issue
(#16090) (#16092)
discard 4050e9d7af9 [To dev/1.3] Pipe: Fixed the missing bans for pipe memory
management (#16088)
discard e7c435d1233 [To dev/1.3] Pipe/Load: Implement multi-disk awareness of
multiple file systems during file copying and moving (#15356) (#16052)
discard 3542849439d [To dev/1.3] Pipe: Fixed the issue that frequent logins on
the receiving end caused indicator leaks #16076 (#16085)
discard 2992c857ff5 [To dev/1.3] Pipe: Fixed the default param of single entry
of disruptor queue & Banned memory checks from some missing pipe ITs & Do not
check non-user pipes (#16078)
discard f8df2e28e2e [To dev/1.3] Pipe: Modify Sink batch event length related
metrics (#16066) (#16074)
discard e3706120ed9 [To dev/1.3] Pipe: Modify Sink Batch Metrics (#16018)
(#16064)
discard 6d1ea7904df [To dev/1.3] Change sort_buffer_size_in_bytes default value
discard 26c875b63ba [to dev/1.3] Cherry pick 'estimating inner compaction task
memory during selection (#15257)' & Fix estimating memory cost for string type
in compaction (#16048)
discard 14e13d8ecea [To dev/1.3] Pipe: Change the name of the Extractor plugin
to Source &&Change the name of the Connector plugin to Sink (#16034) (#16045)
discard 503e9e13e93 [To dev/1.3] Pipe: Fixed the bug that concurrent
modification / compaction of the mod file may cause mod hard-link failure
(#16044)
discard c621be5cfba [To dev/1.3] Pipe IT & Subscription IT: migrate workflows
that are not in HighPerformanceMode to daily IT (#15971) (#16046)
discard 9b30fad4090 Bump TsFile version to 1.1.2-250725 to introduce
compression type seperated by data type (#16032)
discard d34bf8f63ca [To dev/1.3] Pipe: Simplified the hybrid down-grading
logic (#16040)
discard bd9808f0ab1 Add WAL entry number for one TsFile metric (#15818)
(#16011)
discard 9409f6097c3 [To dev/1.3] Optimize partition cache getRegionReplicaSet
interface performance by batching
discard 01adb2cb20b [to dev/1.3] Set global time filter before analyzing last
query
discard 63684f9003b Pipe: Fixed the hard-link lock problem & Some pipe CIs on
master (#16006) (#16012)
discard 284282eadf4 [To dev/1.3] Pipe: Exclude the tsFiles / insertNodes from
transfer time metric which have not be sent (#16015) (#16016)
discard 8d2eae6b794 [To dev/1.3] Pipe: Optimized the degrading logger &
Deleted useless UT & Copied some historical filter logic from dev/1.3 (#16019)
(#16020)
discard f3dbcfb84c6 Pipe: Fixed the compilation failure of dev/1.3
discard 4d21b54c032 [To dev/1.3] Pipe: Fix compilation failure caused by
#16010 (#16013)
discard 4a1762d846e Pipe: Removed the old useless loopback detection logic
(#16007) (#16010)
discard 7a39c140ee7 [To dev/1.3] Pipe: Report progress index for filter-outed
insertion events in realtime extractors (#15975) (#16003)
discard 608a435e8d4 [To dev/1.3] Pipe: Handle existing hardlink in
createHardLink method (#15998) (#16004)
discard 0151030867e [To dev/1.3] Pipe: Do not transfer historical tsFiles when
restarts in realtime-only mode (#15999)
discard 69f23050a79 [To dev/1.3] Pipe: Update the log of the heartbeat process
reported by DN to CN (#15983) (#15997)
discard 49e0dae34c2 Pipe: Reduce IoTDBAirGapConnector Handshake times
(#15990)(#15993)
discard 7c9ac43b5d7 Pipe: Fix the problem that a cluster crash in the
multi-cluster receiving end causes all synchronization to be suspended (#15962)
(#15991)
discard d2f9f843ca7 [To dev/1.3] Cherry-Pick:"Enable the kernel to support
passing topics to MQTT custom plugins" and "Disable the parameter
'ALLOW_ZERO-BYTE_CITE_SIDED_PROPERTY1 NAME' and fix null pointer exception"
(#15985)
discard 120d056cca3 [To dev/1.3] Pipe: Fixed hard-link problem (#15984)
(#15986)
discard ec95538b2d4 [To dev/1.3] Pipe: Fixed the database cache parallel
creation logic
discard 0c428dab7d1 Fix the handling of empty value chunk when load splitting
time partitions
discard 73a49451591 Pipe: Report progress index for filter-outed tsfile events
in PipeHistoricalDataRegionTsFileExtractor (#15963)
discard 5bf9360ae8c [To dev/1.3] Pipe: Added progressIndex reset function to
the resource resetting script (#15957)
discard 1f8b242f6ff [To dev/1.3] Pipe: Fix DataNodeShutdownHook waiting report
logic and add capture history file log (#15952) (#15951)
discard 9f520acd505 Pipe: Fixed the ping-pong of certain realtime tsFiles
(#15949)
discard 025bf970cf1 Pipe: Added rate limiter for tsFile sending (#15765)
(#15947)
discard bf287358726 Pipe: Fix connection leak caused by clients not closed
after task dropped (2 situations) (#15910) (#15929)
discard 6da6cdd2421 [To dev/1.3] Fixed multiple bugs of pipe
discard 9418d45a9f3 [To dev/1.3] Avoid NPE while stop DN (#15940)
discard 311a147be1f [To dev/1.3] Add more checkpoints in series scan
discard fcb35355926 [To dev/1.3] Pipe: Add a tool for validating and repairing
isGeneratedByPipe mark in tsfile resources (#15934)
discard b3706e07c37 Bump org.apache.commons:commons-lang3 from 3.13.0 to
3.18.0 (#15922) (#15932)
discard 9ff7820fc6c [To dev/1.3] Revert Pipe: Try to persist progressIndex in
local for resend event more efficently (#15599) (#15926)
discard 28ad46b444e [To dev/1.3] Fix potential memory leak of Memory Pool
discard 7b771cf947c [To dev/1.3] Merge last query scan node of same device
discard 8cec051dc5f [To dev/1.3] Pipe: Reduced the progress index report
interval & Added some logs (#15905) (#15908)
discard dde02fa78d0 [To dev/1.3] Pipe: Enabled waiting for pipes to finish &
progress index persist to config node in shutdown hook (#15896)(#15901)
discard 4e75683cc7d [To dev/1.3] Fixed the NPE caused by view permission check
(#15876)
discard be0b89ee8de Pipe/IoTV2: Persist progress index locally before shutdown
to accurate recovery after restart (#15779) (#15887)
discard d0dbc971f3e [To dev/1.3] Try delete sort tmp after driver is closed
discard 6af82023c39 Pipe: Fix the error of Client object returning to object
pool after file transfer is completed (#15883) (#15885)
discard 1dae5d6b30b [To dev/1.3] Fix dead lock when take snapshot for Trigger
and UDF
discard c21dc96b637 [To dev/1.3] Correct the memroy calculation of
BinaryColumnBuilder
discard 64f80859fa5 [To dev/1.3] Subscription: intro poll and prefetch v2 for
tsfile topic (#15790) (#15865)
discard fb20273153c [To dev/1.3] Pipe: prevent historical extractor from
forwarding TsFiles generated by pipe when isForwardingPipeRequests is false
(#15845) (#15864)
discard 5755bc0fb83 [To dev/1.3] Subscription: apply IoTConsensusV2 as cluster
mode for integration test (#15546) (#15852)
discard f24704d65a9 [To dev/1.3] Pipe: Add upper bound check for Pipe request
decompression buffer (#15699) (#15806)
discard 212e426c63c Subscription: add config to enable or disable subscription
(#15820) (#15822)
discard 3b4e830fba7 Reduce default value of rpcMaxConcurrentClientNum (#15260)
(#15848)
discard 80b9114109f [to dev/1.3] Parallel disptach read fragment instance
discard 205b97f1d98 [To dev/1.3] Correct status code from 301 to 719 while
memory not enough & Record release resource blocked too long by driver (#15829)
discard ed0c8e55d35 [To dev/1.3] Throw CANNOT_FETCH_FI_STATE(722) instead of
301/305 while DN restarting
discard 8f4d49d5b48 [to dev/1.3] Fix the returning state of
NotifyRegionMigrationProcedure (#15802)
discard cc015b07a62 [to dev/1.3] Prevent the contents of
log_datanode_sample_query.log and log_explain_ananlyze.log from being output to
log_datanode_all.log (#15801)
discard f95686d640b [To dev/1.3] Correct Block Queue Time metric
discard e33f3fa3c71 Pipe: Fixed the NPE caused by the compression timer
(#15782) (#15783)
discard 5d7297210f4 Subscription: return immediately when unsubscribe empty
complete topics (#15770) (#15781)
discard 7ec80be4673 Pipe: Fix the inconsistency between schema and values
columns in the process of building tsfile (#15625) (#15778)
discard 61191b9fd26 Load: Convert to tablets when node is read-only (#15693)
(#15774)
discard bd0688c8689 Pipe: Add retry for tablet batch req to avoid
retransmission when memory is insufficient (#15715) (#15771)
discard a97465ad23f Pipe: Fixed the NPE when closing sync connector (#15772)
(#15776)
discard b2b6e24a480 [To dev/1.3] User password encryption upgraded from MD5 to
SHA256 (#15762)
discard f35369a5e44 update version ratis from 3.1.3 to 3.2.0-3247c7f-SNAPSHOT
(#15763)
discard f20f09b0a4e [To dev/1.3] Fix thread leak in session while connected DN
is down
discard b0bb072755a [to dev/1.3] Add metric for aggregator
discard 9365af92b7f [to dev/1.3] Fix replication factors of root.__system
(#15759)
discard 9ac812551d6 Pipe: Set WAL to uncompressed when using real-time sync
(#15733) (#15757)
discard 7af19d3c8fc Conf Template: Fix wrong symbol (#15748)
discard b163d623980 Pipe: Delete the extra tags created by the
PipeWALInsertNodeCacheMetrics (#15761) (#15760)
discard 14fd2c5f22d Pipe: Fixed the insert node EMA logic for degrading
(#15741) (#15758)
discard a6999160f26 [To dev/1.3] Avoiding error log by removing ThreadLocal
for Mqtt Client
discard 68472bf3d77 [To dev/1.3]Fix TypeProvider and AggregationDescriptor
serde in Templated Query
discard 830ed782935 [To dev/1.3] Enhance "remove region" sql to handle the
case of DataNode not exist (#15744)
discard 34809ea149c fix datanode check (#15730) (#15737)
discard cde113395f8 [To dev/1.3] Fix timeout didn't pass to client bug (#15743)
discard 607a09be6de [To dev/1.3]Support order by time for Agg align by device
query with cross region data
discard 293e72f1744 [To dev/1.3] Correct binary column memory calculation
discard 075d50cb824 [to dev/1.3] Make the root.__system database has a normal
number of replicas (no longer forcing the replica to be 1)
discard 6bfb7c88a5c Subscription IT: intro retry rule for flaky tests (#15698)
(#15721)
discard 91d4599a9f2 Fix arrary index out-of-bounds in agg query with align by
device when cross region
discard 4af07852266 Subscription: unsubscribe completed topics when remove
consumer config (#15660) (#15696)
discard cce0eb3e7d5 Subscription: optimize prefetching queue report state
overhead (#15664) (#15697)
discard 55bd49324b9 [To dev/1.3] Pipe: Fixed the problem of not being able to
write normally due to insufficient memory (#15701) (#15705)
discard 348d4cda8c2 [To dev/1.3] Pipe: Changed the default batch memory
request size to avoid CI failure (#15690) (#15704)
discard 3d3b5d8ed13 Pipe: Fix the problem that the Pipe memory block fails to
call the Wait function (#15688)
discard e48d6a3bc60 Pipe: Fixed multiple bugs (#15674)
discard 2dd1b511f4e [To dev/1.3] Pipe: Fixed the metric NPE caused by batch
disable (#15672) (#15673)
discard 150942c5f1d [To dev/1.3] Pipe: Add InsertNode & tsFile transmission
time metrics (#15668) (#15670)
discard dbec8cf63d4 [To dev/1.3] Pipe/IoTV2: Try to persist progressIndex in
local for resend event more efficently (#15599) (#15669)
discard b8a25d59b11 [To dev/1.3] Pipe: Fix TSFile transfer blocking InsertNode
sending (#15666) (#15667)
discard 2e4d053a005 [To dev/1.3] Pipe: Changed the default value about batch
delay configuration (#15657) (#15658)
discard ed52dbdf98b [To dev/1.3] Pipe: Add retry when TsFile parsing failed to
avoid race among processor threads (#15624, #15644) (#15659)
discard 8a55f5929b4 [To dev/1.3] Load: Introduce thread pool for tablet
conversion and insertion (#15661)
discard 55b07754fa2 [To dev/1.3] Pipe: Applied the login function to config
receiver (#15258) & Pipe: Fixed the bug that config receiver cannot detect
runtime password change (#15621) (#15647)
discard 7f533baa6dd [To dev/1.3] Pipe: Fix the problem that the initialization
of Pipe consumer memory module caused DN writing to get stuck (#15645) (#15648)
discard 03188e9d77a [To dev/1.3] Pipe: Fixed the problem of null pointer and
incorrect Tablet format being modified during TSFile construction (#15602)
(#15623)
discard eb19006952a [To dev/1.3] Pipe: Fixed the issue that the DropPipe
Connector subtask process waits too long for the callback thread to end
(#15605) (#15638)
discard d78eaf491cd [TIMECHODB][To dev/1.3] fix tests
discard f99a1307545 [TIMECHODB][To dev/1.3] fix tests
discard 95d3ce9df56 [To dev/1.3] Update last cache in load (#15637)
discard 41a54764578 [To dev/1.3] Ignore not exist when storage is not ready
discard a75434aacb3 Pipe: Unbinded the default meter for remaining insertion
event count for hybrid degrading & Changed some default values of related
properties (#15615) (#15620)
discard 7615710e7b3 Pipe: Optimize Drop Pipe high priority tasks cannot obtain
SubTask object lock (#15404) (#15610)
discard 0cb08d304a7 Subscription: support unsubscribe from completed topics
under client heartbeat thread (#15595) (#15603)
discard da6fdc73866 Pipe: Optimize Batch and WAL memory allocation algorithms
(#15534) (#15609)
discard fd65f358269 Subscription: retain tsfile events in tsfile batch to
avoid premature commit (#15598) (#15601)
discard da9b73cea50 Pipe/Load: Assign distinct progress indexes for loading
tsfiles in time partitions to reduce pipe reprocessing after restart & Decrease
pipe heartbeat interval (#15583) (#15608)
discard 5bbe97174f1 Pipe: refine memory cost estimation of Binary types for
more precise memory control (#15540) (#15612)
discard 48029e7b05a Pipe: Fixed the bug that the insertion for newer tsFile in
one region may report progress beyond the older tsFile when it is not flushed
(#15515) (#15596)
discard 7bdbb75654a [To dev/1.3] Fix illegal path exception message and don't
effect other exception handler. (#15575)
discard ee8ece01d44 [To dev/1.3] Implement high availability for the C++
client and support tsblock (#15594)
discard e5fa80cc2d2 Pipe: add mark-as-general-write-request parameter in pipe
to force forwarding event (#15572) (#15582)
discard b25e84dc475 [To rel/1.3][AINode] Return ainodeClient in clientPool
discard 832f68e2091 Pipe: Enable synonym detection for OpcUaConnector (#15573)
(#15576)
discard c49e4f5da33 Subscription: support drop subscription from session &
intro allTopicMessagesHaveBeenConsumed for pull consumer (#15486) (#15568)
discard 65a6bb979f0 Pipe: Added skip-if semantic to iotdb-connector (#15530)
(#15553)
discard 84e5391ff7b Pipe: Optimized the hybrid switching algorithm (#15528)
(#15554)
discard 8b38b331951 Remove all kinds of ProcedureException's subclass & Fix a
security problem (#15563) (#15567)
discard 4e55ed7d763 Subscription: decrease reference count for managed parsed
tsfile event (#15555) (#15558)
discard fbfd12672d6 [To dev/1.3] Correct error messages when encountered
IllegalPathException (#15549)
discard 8ae8f283264 Load: fix memory leak when failed to send chunk data in
first phase (#15518) (#15542)
discard 777f6036d31 Load: fix data loss when loading different files with same
name in the same directory (#15527) (#15543)
discard 998ef23a6d1 Subscription: fully managed tsfile parsing process for
tsfile format topic (#15524) (#15529)
discard 758e72044a2 Async Load: Set the database name null when appropriate &
Enable auto-creation of the database by reading the isAutoCreateSchemaEnabled
flag from config (#15489) (#15520)
discard b1412d5cc27 Load: fix memory leak when failed in 2nd phase (#15503)
(#15513)
discard c481806ea63 Pipe: Fixed the bug that sorter may use wrong value when
there are duplicated timestamps & Refactor (#15488) (#15500)
discard afe3c5264b2 [To dev/1.3] Remove SessionPool sensitive info (#15507)
discard 41ce3d91129 [To dev/1.3] Fix auto cleaning partition table bug
discard 3e5213cdf4d [To dev/1.3] Use reference time position for
PartitionTableAutoCleaner
discard 2dcdf42fdfa Pipe: Added metrics for batch & handler size & compression
ratio & compression time for iotdb connector (#15397) (#15482)
discard 732f2f7764a Pipe: Enable flushing storage engine after last terminate
event reported (#15465) (#15481)
discard 34acb23c5f0 Load: Enhanced the auto-creation logic (#15265) (#15474)
(#15473)
discard 815db7c424d Pipe: Fixed the bug that disruptor queue close may block
forever by not waiting real-time tsFile close (#15464) (#15470)
discard c5616bf7af0 Pipe: Added max / min function to aggregate-processor
(#15459) (#15469)
discard 562cbbd4f73 Pipe: Fixed the deadlock cause by terminate event
reporting & Added sink.batch.max-delay-ms to enable delicate control over batch
delay & Fixed the bug of premature halt in extractor snapshot mode cause by
real-time-first transfer & Stabilized the trigger of default batch sending &
Added "isNeedToReport" getter in PipeRawTabletInsertionEvent for user-defined
plugins & Reduce logs from PipeEventCommitter (#15377) + Fix batch type can not
be changed & Enhance close() in [...]
discard 38054163a29 Subscription: mark topic as completed when there is no
corresponding prefetching queue (#15433) (#15461)
discard d0abcb2ba52 Subscription: detect outdated subscription event for
tsfile message (#15430) (#15460)
discard da1a4a3b143 [TIMECHODB][TIMECHODB] [to dev/1.3] fix ttl migration
lower bound overflow
discard 75953f451d2 [To dev/1.3] Fix predicate push down when first child is
Constant in Comparison Expression
discard f36c43814b3 Pipe: Implement hot loading of Pipe configuration
parameters (#15292) (#15422)
discard 592b7e0dc4d Pipe: Implement hot loading of Pipe configuration
parameters (#15292)
discard ea2c7a65ba1 Procedure: Fix the concurrency error during
StateMachineProcedure snapshot (#15417) (#15423)
discard 598a32278d9 Fix memory leak in wal compressed buffer (#15418)(#15419)
discard a293b3a60d0 Load: Supports metrics in the Async Analyzer stage
(#15312) (#15409)
discard 06e48fd5603 [To dev/1.3] Add authorization for metric prometheus
report(#15412)
discard 5c658dbaee9 Adapt TIMESTAMP type when import data (#15390)
discard 462957fead9 Load: Support Async Load in SQL (#15208) (#15320)
discard 57e8b8422f8 Pipe: fix potential ClassCastException when casting
LocalDate[] in PipeTreeModelTsFileBuilderV2 (#15375) (#15384)
discard 61017e3e134 Load: Do not clear schema cache when last cache is
disabled (#15380) (#15383)
discard 7143d07994d Pipe: Fixed the validation logic of OpcDaConnector &
Optimized the error message when the system is not Windows (#15339) (#15382)
discard 49e515cb3d2 Load: check if the DataRegion is Deleted before loading
the new tsfile (#15346) (#15368)
discard 58d94727efe Pipe: Fix NPE caused by InsertNodeMemoryEstimator
estimating Binary array length (#15321) (#15369)
discard e827faa7f20 Pipe/Load: Remove MD5 check for identically named TSFile
to speed up Active Load (#15311) (#15370)
discard 6d888fd25c2 Pipe: use mem table to batch write data into tsfile
(#15276) (#15353)
discard e1acb91bcd2 Subscription: [Bug] When using SubscriptionPullConsumer to
consume data, an error is reported when configuring
ConsumerConstant.NODE_URLS_KEY as the cluster address. (#15322) (#15358)
discard 8d623930ffb Subscription: detect outdated subscription event for
better consumer exception control (#15326) (#15352)
discard 63dc454f9c4 Pipe: aggregate tablets with different measurements under
the same device before write into tsfile (#15193) (#15351)
discard 73d88dffa55 [to dev/1.3] Add getBlob and getDate for
SessionDataSet.DataIterator & fix bugs
discard 305d28d56a0 [To dev/1.3] Make deserialize of AggregationDescriptor
AttributesMap use LinkedHashMap
discard 5e1865aaa9d refactor: load max page&chunk configuration in
ReadOnlyMemchunk and M… (#15310)
discard 1c9227c0834 [to dev/1.3] Separate fully dirty files by partially dirty
files task (#15342)
discard 49796fdedf4 [To dev/1.3] Throw exception when wal entry is too large
discard df7cc0676a2 [To dev/1.3] update tsfile version to 1.1.1 (#15334)
discard 77c969d2252 Subscription: poll heartbeat event when there are no
consumers (#15307) (#15325)
discard d7c95d5a2e2 Add retry for inactivePeer of region migration (#15294)
(#15303)
discard ab0c4838bba Optimize group by query in ClientRPCServiceImpl to reduce
cpu usage (#15178)
discard 4253cbb3e85 [To/dev 1.3]Get correct TTL in tree model (#15256) (#15298)
discard 1fcb22044b6 [To dev/1.3] perf: add encodeBatch interface to accelerate
flushing for sequential insert (#15244)
discard 39ff3c1b5a0 Load: Batched tablet insertion during conversion (#15125)
(#15247)
discard 33ebed062e4 rest add support show models (#15289)
discard f210471fca3 Load: Support converting mini TsFile into Tablets & Adjust
the way to extract metrics & Fix file not delete when analysis cast happens &
Pipe IT: Ignore IoTDBPipeProcessorIT.testTumblingTimeSamplingProcessor (#14784)
(#15199)
discard 7f0368b49ef Pipe IT: Fixed the issue that the Pipe IT test error log
could not be printed (#15242) (#15283)
discard 52ac84d7321 Pipe: Added memory control for aligned chunk reader in
TsFileInsertionEventScanParser & TsFileInsertionEventTableParserTabletIterator
(#15222) (#15270)
discard 8e15f324363 Pipe: Added total floating memory usage for mem-ctrl of
linked but deleted tsFile resource and insertNode memory (#15205) (#15268)
discard da0efc80758 Pipe: Optimized insert node cache hit possibility & Pipe:
Set thread name for pipe receiver (#15263) (#15264)
discard 939035f8d87 [To dev/1.3] Enhance remove confignode robustness by
increase waiting time for new leader #15262
discard f8a981348d8 Load: Implement region operations cache for load × region
migration detection (#15210) (#15246)
discard ad9bd303420 Pipe: Fix stuck caused by async connector client not
returned after transferring tsfiles & Fix validateTsFile and
shouldMarkAsPipeRequest may not be effective (#15245)
discard ce57af8c3b2 Pipe: Add metrics for tsfile to tablets invocation call
count and time (#15202) & Pipe: Prevent Duplicate Time Usage Reporting on Close
in PipeTsFileToTabletsMetrics (#15220) (#15224)
discard 6555199b86f Pipe: Added memory control for receiver insert statements
(#15046) (#15047)
discard f2bf2e9c692 Pipe: Reduced the log of epoch switching & Refactor &
Optimized the memory reservation logic of tsFile parser provider & Subscription
IT: assertGte for received tsfile count (#15068) (#15070)
discard de4a627b080 Pipe: Fixed the issue where the storage engine referenced
an incorrect Mod file after the Mod file was cleaned up after the Receiver
thread exited. (#15235)
discard 9eb56ecc3df Subscription: distinguish between reference count of ack
and clean in tsfile batch to avoid cleaning before ack (#15229) (#15233)
discard b0551857533 Pipe: Enable showing WRITE_BACK_SINK (Fix IoTDBDatabaseIT)
(#15209) (#15226)
discard 9695184a73f Load: Add default value for multi disks awareness (#15216)
(#15218)
discard 85520eef717 [To dev/1.3] fix: MemoryNotEnough exception & clone &
delete issues (#15170)
discard aeea6228df9 Load: Support multi-disks awareness for IoTV2 and Pipe
(#15181) (#15213)
discard 49c3e0907cf Pipe: iotdb-thrift-connector async retry mechanism
(#14916) (#15201)
discard 26ebb10eed0 Improve ConfigNode removing #15189 (#15195)
discard 0c256e7a055 Subscription: intro SubscriptionLogManager for global
uniform downsampling of prefetched logs (#15175) (#15187)
discard e5524a105b2 Fix division by zero error when flush memtable (#15183)
discard 4af6dcc13de Pipe: Fixed Async Connector Repeatedly Putting Events into
RetryQueue (#15179) (#15184)
discard ec2c64b17d8 Load & Region Migrate: Notify all DNs before and after RM
(#15032) (#15131)
discard 4582358ab3f Pipe: Fixed the ttl privilege logic at receiver side
(#15135) (#15145)
discard 7d541092f0a [To dev/1.3] Update tsFile snapshot version
discard 78cc3703c94 [To dev/1.3] Restore rollback for UnsetTemplateProcedure
(#15088)
discard d848e366d3c Fix bug that the partition table auto cleaner cannot be
activated (#15158) (#15162)
discard 8762e3c4903 Pipe: Fixed the bug that OPC DA sink may free a string
multiple times (#15165) (#15166)
discard 9cc362c57c2 Updated moquette version to fix MQTT write direct memory
leak issue (#15168)
discard 60a9b3d3659 [to dev/1.3] RegionMigrateProcedure and
RegionReconstructProcedure no longer acquire lock
discard 5d8943faf04 [To dev/1.3] Print debug log only if debug is enbale
discard 17580cd15b1 RegionMigrateProcedure and RegionReconstructProcedure no
longer acquire lock #15122 (#15146)
discard c1885e0ce83 [To dev/1.3] perf: various types of iterator for multiple
tvlists in memchunk (#15115)
discard 443bae5b982 [To dev/1.3] Enhance remove unexisted datanode error
message #15140
discard 38965ca84c6 [To dev/1.3] Optimize query execution in easy query case
(#15128)
discard 630a8c60492 Make removed confignode can rejoin cluster without
deleting data dir (#15118) (#15123)
discard 4e6c273f50a Subscription IT: fix
IoTDBConsumer2With1TopicShareProcessTsfileIT (#15110) (#15121)
discard 3203d497aeb [To dev/1.3] Region group status refactor #15119
discard 11f5c3c98a0 [To dev/1.3] Enhance remove unexisted confignode error
message #15120
discard 09ef087575b [TIMECHODB] fix compile
discard 8a34a9929af [to dev/1.3] Timestamp of Long.MIN_VALUE may be deleted by
ttl in compaction task (#15084)
discard 3a68f09613b Fix template extension with null value (#15104)
discard 233a8cee495 [RTO/RPO] Phi logging/concurrency Improvement (#15092)
(#15093)
discard c739f1b0a44 Fixed the wrong "maxRowNumber" in OPC DA Sink null value
judgement (#15066)
discard 1488afdb514 Fix the exception handle of InsertionCompactionTask
(#15086)
discard 2d0d2941f87 Pipe: Fix pipe executor stuck by unlimited file event
memory allocation retries & Pipe: Fix IO triggered in disruptor & Pipe: Fix
forceAllocateIfSufficient & Load: Remove RM detect logic during the second
phase (#15085)
discard 60ee78aeda7 [To dev/1.3] Optimized the error log & enable retry for
exceptions caused by concurrent removal of regions (#15076) #15078
discard e4e6baac413 [to dev/1.3] fix memory cost for aligned TVList (#15081)
discard bbb4bdfb7e5 [To dev/1.3] [AINode] Support output time column for model
inference
discard deec75534e3 [To dev/1.3] Fixed the concurrency bug of create
timeseries / set(unset) template
discard bf54df2e3d9 Pipe: Fixed the pipe parsing bug for logical view (#15055)
(#15056)
discard e6c0ad51945 [TIMECHODB] Remove REMOTE_STORAGE_BLOCK
discard d694c23624f Pipe: Fixed the pipe parsing bug for logical view (#15055)
discard f47b72b4757 Pipe: Fix tsfile resource deserialize failed (#15052)
discard 784dd88271b Pipe: Optimize realtime performace when pipe starts after
long time stop with heavy data backlog (#15048)
discard a841e998e4d Load: Fix memory size counting on cases when query
engine's memory is not sufficient (#15049) (#15050)
discard c482179a411 [To dev/1.3] Optimized the error log for database
inconsistency when adjusting max region group num & Ignore the
DatabaseNotExistsException for adjustMaxRegionGroupNum when querying
dataRegionGroupCount (#15008)
discard c0e49dda120 IoTConsensusV2: persistent isGeneratedByPipeConsensus
(#14938) (#15042)
discard d093862ce4e Load: Detect 2PC Second Phase and RM Running in Parallel
(#15041) (#15020)
discard 67c8fbac869 Subscription: let subscription module fully manage the
parsing process of the insert node event (#15012) (#15043)
discard f5d6fa23b8f [To dev/1.3] Fix PartitionTable auto cleaner IT #15044
discard bf24c0737d2 [To dev/1.3]Memtable enhance fix (#15040)
discard e4564f77318 [to dev/1.3] Fix resetPeerListTest for unstable port
binding #15039
discard 08ea00882bd Load: detect region migration during second phase (#15005)
(#15029)
discard 79ec758c4b4 Fix frozen IoTConsensus sync lag (#15023) (#15025)
discard 34f752c8431 Bump jetty version to 9.4.57.v20241219 (#15004)
discard 5f8ac9b8272 Pipe: implement AutoCloseable for insert node event and
raw tablet event & Subscription: add parameter control tablet event batch
estimate & close memory block in tablet event for iteration snapshot (#14991)
(#15001)
discard e1c0f598c87 Pipe: Fixed the NPE caused by creating a new Region during
the execution of Alter Pipe Procedure. (#14982) (#15000)
discard 8d859469936 Pipe: Refactor pipe metrics related packages (#14997)
(#14998)
discard 252eec7f1bb [To dev/1.3] Fix select time in TreeModel (#14990)
discard eed1b9119e3 [RTO/RPO] Add Phi Accrual for Node failure detection
(#14866) (#14987)
discard 9d841189e1b Shuffle nodeurls to make sure all connections aren't to
the first node by default #14983 (#14986)
discard a214f82836f Subscription: add parameter to the clean up method to
distinguish the force close situation & fix reference count management for
iteration snapshot (#14966) (#14984)
discard 031485aadb3 Add -lpf param in ExportData (#14956)
discard ef3763ee4dc Fix flush old leader NPE when rebanlce #14981 (#14985)
discard 84e38935fe9 Pipe: Implemented OPC DA Sink for local COM & Fixed the
newest value of OPC UA Sink (#14964) (#14978)
discard 2456bf67eb0 Pipe: Make client-server the default setting of
opc-ua-sink (#14979) (#14980)
discard a8257c84b17 Pipe: Reduce the frequency of printing logs when
AirGapConnector connection fails (#14949) (#14973)
discard 3a80ec0c33c Fix the support of MQTT with java8 (#14974)
discard fbc508dc2d1 finish (#14366)
discard 73f75127a53 [IoTConsensus] More accurate statistics on IoTConsensus
memory management (#14965) (#14969)
discard 094d33f7abf [To dev/1.3] Memtable enhancement for query (#14942)
discard 31e70cc7ee2 [To dev/1.3] Adjust default data region num per node from
5 to to cpu core / 2 & IoTConsensusV2: Flush old leader when leader transfer &
Delay the execution of invalidateSchemaCache after leader change (#14963)
discard d8c38fe3d27 Subscription: check if all topic messages have been
consumed when client polling (#14937) (#14953)
discard 3c36ec35d25 [To dev/1.3][AINode] Optimize the error information when
dropping built-in model
discard dc661011693 Add logs for PartitionTableAutoCleaner (#14934) (#14948)
discard 1fc5d3fe029 Fix state setting of AbstractOperatePipeProcedureV2 &
Enhance state checking of StateMachineProcedure #14959 (#14961)
discard f95f080d228 [To dev/1.3] [RATISCONSENSUS] Bump ratis version to 3.1.3
discard e9a99d0e22d Delete remove node logic in ServerCommandLine #14933
(#14950)
discard 017f4e1b04a Pipe: Modify MaxAllowedPinnedMemTableCount to adapt to
changes in the number of DRs & Modify the implementation of the poll method in
PipeRealtimePriorityBlockingQueue to reduce commit queue backlog & Adjust the
default thread count related to Pipe for better performance & Significantly
reduce pipeMemoryAllocateRetryIntervalMs & Provide a switch for memory control
of ConnectorReadFileBuffer (#14917) (#14946)
discard b02b321a945 Pipe: Fix the protential resource leak issue of async
client when async manager is closed (#14929) (#14947)
discard 952bf816dd2 Fix class name of RPCServiceMBean #14940 (#14945)
discard 5426812384f Load: Add mods file metrics count (#14930) (#14944)
discard 1f45b93e925 Subscription: avoid null pointer exception when get
current response due to concurrent operations (#14926) (#14932)
discard b00ee42c8cb [to dev/1.3] Improve authority control of cluster
management (cp 14924) (#14931)
discard 7151185ae4a [to dev/1.3] [RTO/RPO] Unify retry logic on
SessionConnection (#14927)
discard 982558be5ab [to dev/1.3] Fix IT names & Fix region operation related
IT (#14925)
discard 03b2b084ec8 [to dev/1.3] IoTConsensus no longer stores the peer list
locally on the DataNode (#14900)
discard 3844da2fce9 Initialize WALNode when DataRegion is created for iotv1
and iotv2 (#14918) (#14921)
discard 3bf2e28f202 Reject inserting invalid timestamp string (#14913) (#14920)
discard fa407281e0b [To dev/1.3] Add connection_time_out_in_ms for Python SDK
(#14919)
discard f3cc0719298 Subscription: close memory block for previous tsfile
response (#14909) (#14914)
discard 5228374fa1d Pipe: Avoid stuck in insertion process because failed to
allocate memory (#14899) (#14907)
discard 35bdbefb3c9 Pipe: fix threshold judgment for tablet and tsfile memory
block & Subscription: close data container for current PipeTsFileInsertionEvent
in batch (#14901) (#14902)
discard 7289ad55572 Fixed the bug that procedure rollback may generate NPE &&
some of the rollback steps may not be / be extra executed (#14871) (#14872)
discard 803bbd55d13 Add Date and Float data IT (#14895)
discard 3775c92bed2 Fix the incorrect configuration of the JAVA_HOME
environment variable in script." (#14893) (#14896)
discard 0ccba8eddaa Pipe: Fixed the bug that delete timeSeries / logicalView
cannot be transferred (#14867) (#14889)
discard e9aa0898ef5 Pipe: Reduce degrade log from
PipeRealtimeDataRegionHybridExtractor (#14888) (#14891)
discard 695d7645290 Pipe: bind memory block for PipeTransferTsFileHandler and
PipeInsertNodeTabletInsertionEvent & unify the memory threshold judgment for
tablet and tsfile block & close data container when internally decrease
reference count of PipeTsFileInsertionEvent (#14873) (#14887)
discard 3fe8113291c Subscription: fix consumer infinite pulling event & fully
managed tsfile parsing process & increase the reference count for subscribed
parsed raw tablet event & disrupt parsing requests through the introduction of
randomness & disable prefetch by default (#14856) (#14886)
discard 94ffd2e19fa [To dev/1.3][remove datanode] Delete the SQL of removing
multiple datanodes at the same time (#14879)
discard 6ce34af8977 Pipe: Fixed the DataNode startup failure caused by Pipe
plugin loading (#14816) (#14881)
discard 7327cb8a2ce Add SSL support to Python client (#14864)
discard 064a8c0780a [To dev/1.3] Fix reload4j vulnerability issue (#14877)
discard 86ded69d348 Pipe: Implement force forwarding feature where the Pipe
sender can force the receiver to forward the received event (#14847) (#14875)
discard 83a6a71b439 Pipe: Introduce timely flush options & Execute flush after
pipe watchdog restarts & Log degrade reasons for debugging (#14865) (#14869)
discard ae85f686b4e Remove JDBC sensitive information output (#14857) (#14863)
discard e1f67b43f95 Pipe: adjust default pipeRealTimeQueuePollHistoryThreshold
to reduce retransmission upon frequent rebooting (#14860)
discard ce6400033ab Pipe: Fix the problem that the receiver constructs
InsertStatement causing the MeasurementShcema to not be correctly set to null
(NPE) (#14831) (#14858)
discard 1d9e8a777ad Subscription: fix nack tablet response & periodically
report the state of prefetching queue & improve logs for subscription providers
(#14822) (#14836)
discard a3abd640f77 Metric: Add pipe linked tsfile size and count metric
(#14768) (#14852)
discard 7ab32c09787 Delete remove-confignode.sh and remove-datanode.sh (#14855)
discard 1114c5e764e [To dev/1.3][remove confignode] Add Remove ConfigNode SQL
(#14854)
discard 873f99baaf5 Load: convert to insert tablet on region replica set
changes (#14717) (#14833)
discard e3e341356da Pipe: Default parameters adjustment for pipe threads and
pipeStuckRestartMinIntervalMs (#14819) (#14838)
discard b92a891a121 Pipe: avoid event accumulation in the stale sink pending
queue & promptly clean up closed processor subtasks & close parser when
releasing phantom reference of tsfile event (#14820) (#14835)
discard 38782c5dc62 Pipe: incorporate batch data into
TsFileInsertionEventScanParser memory control & Subscription: close data
container in tsfile event & bind memory block for tablet response & generate
empty tablet as initial response & offer subsequent tablet response before ack
& expose prefetch and backdoor configs & best-effort disorder control (#14752)
(#14849)
discard 880847c904f [To dev/1.3] Do not pritn host and port when failed to
connect through CLI (#14845)
discard bf8ed2bcdc0 Enhance getLatestRegionRouteMap log for debugging #14830
(#14842)
discard ae304444659 Check time precision for negative timestamps (#14828)
(#14832)
discard 66e837e3451 Fixed the bug that internalCreate(Multi)TimeSeries may
write empty device when measurements are all trimmed (#14827) (#14829)
discard 24a642dd982 Bump net.minidev:json-smart from 2.5.0 to 2.5.2
discard 2a368e36425 [To Dev/1.3] [AINode] fix missing dependency in wheel file
discard 69e844f46a3 [To dev/1.3] Fix null measurement name issue in
insertTablet (#14800)
discard 3d04253ac1f [To dev/1.3] Pipe: Introduce periodic verification for
username and password on receiver side (#14764) (#14790)
discard 796be0d9643 [To dev/1.3] Pipe / Load: Enable validation skip for load
tsFile (#14774) (#14776)
discard c37ce04ad63 Region group status refactor (#14738) (#14760)
discard a7804fe5524 [To dev/1.3][remove datanode] Add Remove DataNode SQL
#14761
discard 158ce5c9dcd [To dev/1.3] Let the DataPartitionTable be automatically
cleanable (#14737) (#14759)
discard fd47c4bef57 Fix region reconstruction IT (#14753) (#14758)
discard b03446647c3 [to dev/1.3] Extract "merge" method for SearchNode (#14757)
discard b5f2e1e0405 Adjust default wal_throttle_threshold_in_byte and
region_migration_speed_limit_bytes_per_second (#14653) (#14756)
discard 6e0f4d52faf [TIMECHODB][TIMECHODB] Reopen last cache defaultly in
timechodb
discard 60457eab48d [TIMECHODB][TIMECHODB] Subscription IT: sync subscription
regression tests from github dev/1.3
discard 17981b006cb Fix createView NPE issue when region migration #14746
(#14747)
discard 219992f5305 Refactor procedure framework (simplified
StateMachineProcedure, and some other things) (#14683) (#14741)
discard 97b5bfeff6e Pipe: Fix HA issues caused by exceptions not handled in
handshake (IoTDBAirGapConnector / IoTDBSyncClientManager) (#14706) (#14730)
discard 101ec21b474 Pipe: Fix the incorrect use of iterators in Load File
(#14718) (#14728)
discard 2e8490d0ccd Pipe: Optimize receiver insertion statements' success
status judgment (#14672) (#14727)
discard f5507b111e6 [to dev/1.3] Extend Region & Remove Region & Reconstruct
Region (cp 14634) (#14720)
discard be0bd205973 [to dev/1.3] The time range of device in resource file may
be larger than the actual time range in tsfile (#14726)
discard 20a39ced039 Subscription: fix method in tablet batch to support
multiple tsfile in the same batch (#14715) (#14716)
discard 87b2f1c50cd Pipe: strict check for synonym pipe parameters to avoid
ambiguity (#14694) (#14700)
discard aa2d384336e Pipe: Fix NPE caused by forced type conversion and fix
IoTDBipipeTypeConversionISessionIT of table model (#14667) (#14670)
discard 0a7785a4fcd Load: Add a new configuration to enable datatype
conversion when converting into Tablets & Refactor LoadAnalyzeException.
(#14646) (#14674)
discard 32f3040d13f Implement mem control for schema snapshot parser (#14156)
(#14682)
discard 2d041e12d9f Clone value array when insert non aligned tablet with null
(#14643) (#14679)
discard 8b755b60b2b Pipe: report linked tsfile size & Subscription: decrease
reference count for other enriched events & add logging to observe possible
stuck situations (#14668) (#14671)
discard b49470d8617 Modify the condition to skip compaction schdule after
insertion compaction task selection (#14644) (#14663)
discard db21a0f51fe Compaction task memory is incorrect when
compaction_max_aligned_series_num_in_one_batch <= 0 (#14603) (#14639)
discard 07cc001a9ac Use DataNodeDevicePathCache when insert by sql (#14666)
discard 5241b638692 Reduced the error log cause by batch activate template
when some devices are already activated (#14661) (#14665)
discard a8a16ef1bb8 Pipe & Load: Retry when a file operation causes an
exception (#14598) (#14655)
discard a69f90d03d1 Load: Consider isGeneratedByPipe mark when executing
tsfile-tablet conversion in analysis stage (#14651) (#14652)
discard 3dd8e5bd088 Load: Convert TsFiles into Tablets when the target regions
are unavailable (#14626) (#14642)
discard e62c49912a0 Pipe IT: Save IT operation logs to the cluster-logs
directory (#14637) (#14638)
discard f52d4c05735 Pipe IT: Extend IoTDBPipeTypeConversionIT retry time
(#14628) (#14636)
discard 7da836ba9e8 Pipe: Fix the problem that the Pipe indicator is
inaccurate and negative (#14627) (#14633)
discard 053c92c1d5b [to dev/1.3] Add compaction selection cached device time
index size metric (#14592)
discard 7e4971fb137 Load: Support auto data type conversion when data type
mismatch detected during analysis stage (#14529) (#14619)
discard 3e86be9fe4a Pipe IT: Retry CI tests if pipe-api download fails & Cache
Maven packages in workflows (#14608)
discard 5032d56d333 Load: remove unnecessary flushes in writer to avoid
generating bad tsfile (#14602) (#14609)
discard b10a3be1495 Pipe: fix the problems that unable to start when cannot
parse reboot times (#14594) (#14601)
discard 921ecb91c70 [To dev/1.3] Bump logback from 1.3.14 to 1.3.15 (#14599)
discard b63200e95a1 Pipe: Fixed the NPE of schema sync in historical transfer
(#14586)
discard 566b6b66f6b Revert "Fix that config changes rejected by DN will be
written to CN's config (#14551)" (#14590)
discard 01bad15af34 Pipe: Fixed the NPE for pipe heartbeat when there are
nodes shutting down (#14584) (#14593)
discard dd80f7a0ffe [To dev/1.3] Fix RatisConsensus client==null exception
when stopping datanode #14583
discard 68ddffbb8bb Pipe: Ensure the idempotency of the historical activation
batch (#14566) (#14580)
discard e628b5e08e6 [To dev/1.3] Detect singular frame lengths in
TElasticFramedTransport (#14572)
discard 3d0b2cd084b [To Dev/1.3]fix: UDAFPatternMatch add validate (#14574)
discard 003cf4d8faa [to dev/1.3] Fix the issue that the cache key used for
queries may conflict (#14561)
discard 29c17c185b0 [To dev/1.3] Fix that config changes rejected by DN will
be written to CN's config… (#14552)
discard 3f3aee56cd8 [to dev/1.3] Compaction Read Metric and rate limit are
bypassed due to parent class modification (#14565)
discard 9065547e5b1 [To dev/1.3] Print current trusted_uri_pattern is error msg
discard eff16715b55 Fixed the issue of NPE caused by unexpected exceptions
thrown during the use of AsyncClient. (#14556) (#14563)
discard cc3a2a3c116 Load: detect region replica set changes due to Region
Migration (#14553)
discard 7136da9ebbb [IoTConsensus] Refine IoTConsensus Configuration logs
(#14542) (#14555)
discard 7572358fa48 [region migration] Log optimization (#14536) (#14545)
discard aa2d56602b0 [To dev/1.3] Add the used memory calculation for
DescPriorityMergeReader which is missed before (#14549)
discard 86d9a226733 [to dev/1.3] Compaction task can not stopped when abort
compaction (#14547)
discard 455ae755903 [to dev/1.3][region migration] Make peer list correct when
IoTConsensus & IoTConsensusV2 & Ratis starting (#14535)
discard 7ff108b5d14 [remove datanode] Remove LoadScore sort to fix
RegionPriority order (#14527) (#14541)
discard 7a168513f80 Subscription: improve `createTopic` API with nullable
properties or when if not exists cond is set (#14516) (#14543)
discard 5b728ac3b12 Subscription: fix NPE when building consumer with missing
id & add more checker for topic operations using session (#14493) (#14515)
discard b76d1bafcce add Content-Type in prometheus reporter (#14507) (#14539)
discard 7c55580ed01 [to dev/1.3] Add lock for insert separator to wal (#14482)
discard 2ab3fb9a84b [To dev/1.3] Fix load data region snapshot miss some
writing metrics (#14533)
discard 2c6e70e0b5f reduce useless loops (#14523)
discard 32474f5a077 fix: docker replace conf sh (#14518) (#14520)
discard 0a8040b429c [To dev/1.3] Support us and ns timePrecision in udf-library
discard a4c0dde45f7 [TIMECHODB] fix ut
discard 1cff98fcf71 [to dev/1.3] apply new configurations in memory before
update file (#14501)
discard b4c2ddaa5b6 [To dev/1.3] Fix error in template + sort + offset + limit
+ align by device
discard e2707f39e26 fix compaction task comparator & fix the conflicts between
inner compaction selection conditions (#14496)
discard eeadc24e8a6 Pipe: Fixed the bug that auth plan with system privileges
can not be transferred (#14492)
discard 15e5658bcbb Pipe: Fix infinite loop when thread is interrupted in
invoking PipeMemoryBlock#close & Avoid throwing new InterruptedException in
conditions that can be self-restoring (#14471) (#14486)
discard 0a4194af744 [To dev/1.3] Pipe: Fixed the issue where partial writing
caused the measurement to be null and caused the memory estimator to throw NPE
(#14391) (#14488)
discard 0de7a8f0df0 [To dev/1.3] Fix setting illegal
default_storage_group_level does not report an error (#14483)
discard 19f09b1e285 [to dev/1.3] Allow hot reloading compaction from disabled
status (#14470) (#14480)
discard 7aa1aa50a52 [To Dev/1.3]Encountering empty tablets during batch export
of tsfile does not affect subsequent export tasks (#14463)
discard fef3abc3770 fix checkNonAlignedDeviceSeries (#14462)
discard ab982439a02 Load: Fix Memory Allocation and Release Mismatch in
LoadTsFileDataCacheMemoryBlock (#14375) (#14466)
discard 9f47ec39d19 Subscription: allow generate subsequent events with the
same tablet batch to avoid large message & improve poll logic to avoid
unnecessary nack (#14452) (#14476)
discard d39eb806e7a Pipe: Added permission check for config receiver (#14418)
(#14456)
discard 7d6758ba73a Pipe: Do not stop runtime agent when removing datanode
(#14474) (#14475)
discard 066fc4ecb20 [To dev/1.3] Bump h2-mvstore to 2.3.232 & Bump
jackson-databind to 2.16.2 (#14473)
discard b2bef3a3268 [To dev/1.3] Bump ratis to 3.1.2-a862328-SNAPSHOT
discard 0da8ddc40a8 [IOTDB-6355] [To dev/1.3] Fix query scan will return
duplicated timestamp or unordered timestamp while TsFileResource degrading
discard 3966a08a149 [to dev/1.3] Add TsfileSize column to 'show regions'
(#14468)
discard 4fdb18e5d8f Add eviction metrics in binary allocator (#14432) (#14469)
discard b29723d01d1 [To dev/1.3] Fix ThreadPool Metric NPE #14460
discard db23e3402b2 Fix ratis byte limit configuration too small
discard 714f317c9ce [to dev/1.3] When the config node can not find the
configuration file, the set configuration command does not update other nodes'
configuration (#14395)
discard 64d09f9172d [to dev/1.3] Fix repair performerWhen the device is
missing from the resource, this part of the data may be lost during file repair
(#14422)
discard ca134b55a0f Pipe: Introduce a minimum restart interval to optimize the
restart strategy to avoid frequent restarts & Stay tsfile extraction mode if
the task is currently restarted (#14374) (#14454)
discard 54ac1cd5de9 Load: flush metadata of generated files to avoid OOM
(#14419) (#14445)
discard 1cb0407d6b6 Pipe: Fix the null pointer exception when the receiver
closes the Session (#14446) (#14453)
discard 6d6eb62813b Load: fix that empty measurement in aligned devices may
cause warnings (#14444) (#14448)
discard 750472e565a Pipe: Fixed the bug that the handling logic of return
status is not of use in convert execution visitor (#14451)
discard 287787cd188 Pipe: fix the reference count leak of events in async
connector during restart (#14324) (#14439)
discard 8a65557cb37 Pipe: Add login logic to receiver handshake (#14401)
(#14440)
discard b6094d8eac6 Pipe: Fix "waitHandshakeFinished" may wait forever when
asyncClientManager is closed (#14373) (#14435)
discard 116dcf8361a Subscription: fix ConcurrentModificationException for
`ConsumerGroupMeta` & fix the logic of `isTopicSubscribedByConsumerGroup` &
avoid consumer from outputting too much content in string form (#14425) (#14429)
discard ed201e28288 Pipe: Fixed the bug that a failed check sum may
permanently disable an air gap receiver & Optimized the air gap file offset
logic & Fixed the bug that not connected socket may die forever in "send"
(#14384) (#14415)
discard af40e598a30 [to dev/1.3][region migration] Remove retry of
RegionMigrateService::addPeer (#14409)
discard bdf52a53ec6 [To dev/1.3] Sampling queries in each DN
discard cb049917f61 [Py-client][dev/1.3] Print Dataset is closed error msg if
user continues to fetch from it (#14397)
discard 33bb99e3220 [To dev/1.3] Fix ThreadPoolMetric NPE (#14405)
discard 5fca6b52e1c fix wal queue stuck and fix metric (#14387) (#14393)
discard 56ab5a5a0dc Fix ThreadPoolMetrics concurrent NPE bug & Fix metric
leaks when frequently creating and deleting database (#14388) (#14389)
discard c4bfde6183a [To dev/1.3] Fix flaky LastFlushTimeMapTest & Fix go
client CI for dev/1.3 (#14403)
discard f140e6acaad [To dev/1.3] Supprt trusted_uri_pattern in config file
discard 516069e54ff Pipe: Fix the deadlock of PeriodicalJob thread caused by
using parallelStream to split restartAllStuckPipes' subtasks (#14392) (#14402)
discard a39c2dceb8c [To dev/1.3]Support auto mkdirs in ExportData (#14378)
discard ac5f840baa9 [To dev/1.3] Fix group by nature month when timezone is
not default
discard 0fa8f3646d5 [to dev/1.3] When deleting data for TsFileResource in
COMPACTING status, the mod file metrics is not modified (#14376)
discard cd6935dc567 Restruct procedure waiting strategy to fix NPE bug when
completed procedures were cleaned before getting result (#14360) (#14381)
discard b21ff810a2a [To dev/1.3] WAL buffer queue memory control (#14379)
discard 45ba6c9be56 [TIMECHODB][TIMECHODB][dev/1.3] fix cannot running
datanode in idea
discard cc832576afa [To dev/1.3][remove datanode] CP remove datanode related
commits to dev 1.3 (#14361)
discard bda7f3e6ab2 [dev/1.3] Bump netty version to 4.1.115.Final && Update
release info after 1.3.3 released (#14359)
discard ee2e17de660 Pipe: add information about sender's IP and port in the
pipe receiver logs (#14343) (#14351)
discard 454d33a12ac [To dev/1.3] Pipe: release resources of pipe event that
have been GCed but the reference count is not zero by PhantomReference (#13360,
#13756, #13813, #13962, part of #13992) (#14355)
discard dc77a9801c1 Fix exec remove-datanode.sh failed in jdk17 (#14036)
(#14353)
discard aa1fe644ee2 [To dev/1.3]Script adaptation to 4 new data types (#14296)
discard aee3d43a4e8 Update export script prompt information (#14276) (#14327)
discard 8981f14cb35 [To dev/1.3] Enable tolerating any exceptions and not
block cluster initialization during schema region recover
discard fedefd46e80 [region migration] Handle InterruptedException during
waitTaskFinish() more properly #14305 (#14347)
discard 2c1ac114558 Pipe: fix the reference count leak of events published in
the assigner during restart (#14308) (#14342)
discard 4baf27dfbed [remove datanode] Fix concurrent modification when
removing fails and rollback #14333 (#14339)
discard a9e9b3c7537 add udaf PatternMatch DTWMatch (#14258)
discard de59331c012 [To dev/1.3] Add Binary Allocator (#14334)
discard 5e49c2549e4 [To dev/1.3][remove datanode] Contribute remove datanode
to dev 1.3 (#14301)
discard 5eeabc326bb Fix error in string/timestamp/date/blob data type + sort +
limit usage in version 1.3.x (#14323)
discard 04e2fc131cc [To dev/1.3] Increase the default upper bound for
ClientManager (#14326)
discard 2a8c103384b Pipe: Added the CreateMultiTimeSeries with merge logic and
disabled timeSeries existence check at SchemaExecutionVisitor for plans
transferred by pipe (#14317) (#14320)
discard d6b2aa6b98e bump tsfile to 1.1.0-241205-SNAPSHOT (#14318)
discard 3921d371e8a Pipe: Fix potential NPE from
WALEntryHandler#getInsertNodeViaCacheIfPossible & Improve performance for pipe
slightly (#14312) (#14316)
discard f5202307159 Fix procedure framework data race (#14309)
discard 25ec8a147a3 Common Config & Pipe IT: Fixed the bug that
dn-connection-timeout and cn-connection-timeout are mixed (#14275) (#14303)
discard fc5977a2fed Pipe: Enhanced the pipe transferred create timeseries
logic to allow merging tags / attributes (#14261) (#14302)
discard 6b3ad59c993 Pipe: fix the issues of excessive stale PipeEventCommitter
logs and missing PipeDataNodeRemainingEventAndTimeMetrics (#14284) (#14298)
discard 438ba6231f3 Pipe: Introduce restart strategy to control resources'
memory only used by pipe hardlinked files & Pipe: fix too many warn logs from
findAllStuckPipes() (#14279) (#14287) (#14297)
discard 14d33879b4e Add avg file size in DefaultCompactionTaskComparatorImpl
(#14270) (#14295)
discard e376c6fad75 [to dev/1.3] Some configuration items may be commented out
when merging old version configuration files (#14249)
discard 25e49d7f41b [To dev/1.3] Fix back-quote remove of Select-Into query
when query is not for raw data (#14274)
discard e3810952ec9 fix bug (#14247)
discard 99465e95feb [to dev/1.3] Enhance repair data file scan util (#14254)
discard c8f4e7c14b5 Pipe IT: Modify the forwarding-pipe-requests configuration
of Double Living IT (#14240) (#14260)
discard 59dbd674a86 Cherry pick commit c5eacf from master (#14255)
discard 3f7f7069f94 Pipe: Allow STATEMENT_STATUS_VISITOR and
STATEMENT_EXCEPTION_VISITOR for data conversion statements on data sync
receiver side (#14220) (#14237)
discard b49835b24ff [To dev/1.3] Fix async recover TsfileResource error handle
(#14235)
discard 69780017d70 Subscription: The usage of bitmap in
SubscriptionSessionDataSet may cause npe (#14124) (#14218)
discard e509f25a566 Pipe: make exception message more friendly when creating
data sync pipe failed (#14208) (#14214)
discard dc0d82eb1d4 Fix AsyncClientManager selector thread leak #14203 (#14206)
discard 73b4109f041 delete type_info parma in import_data.sh -ft sql (#14103)
discard 702c8c15177 Subscription: revert ScheduledExecutorService to
ExecutorService to avoid task queue oom & fix subscription task count (#14186)
(#14187)
discard 68cb1a8c854 Pipe: Reduce the amount of log information printed after a
batch fails (#14172) (#14179)
discard abaa258ef7e [To dev/1.3] Fix stopping cn leader stuck when region
region migration #14176
discard bd01f9f18cc Fixed bug where Ratis could not write large requests and
could not be configured (#14160) (#14166)
discard 12d3dfd5767 Pipe: Fix the problem that the Aligned information of the
Tablet generated by TsFileInsertionEventScanParser is incorrect (#14136)
(#14164)
discard e3ab2354af4 Pipe: Reduce the memory usage & Enable insertNode memory
control for stream mode degrade and stuck restart (#14102) (#14161)
discard 1d908f534e6 PipeConsensus: always execute flush for historical data
extraction of consensus pipe to reduce data sync delay (#14132) (#14154)
discard 88f95b0f892 fix NPE bug & rename some storagegroup to database (#14155)
discard c6db2e063dd bump ratis to 3.1.2-2fe59d3-SNAPSHOT (#14121)
discard c1fc6838ca1 Subscription: stream parsing tablets during the poll
process to reduce memory usage (#14101) (#14110)
discard d3752036a94 [to dev/1.3] Modify env script comment #14117
discard 46503dcbafe [to dev/1.3] Fix heap dump path (#14106)
discard 237a2e75e96 [region migration] Fix IoTConsensus data consistency
during region member changes (#14084) (#14107)
discard 9f758f34283 [To dev/1.3] Prepare release 1.3.3 (#14057)
discard d7998eabdf1 Fix flush command stack problem and clean old code in
DataRegion (#14027) (#14079)
discard a59d049522b [to dev/1.3] Add default value in config node scripts
(#14089)
discard f92330f92f9 Pipe: CI trigger condition ignores changes to query engine
directory (#14067) (#14094)
discard 3ae73a53849 [TIMECHODB] revert integration-test moudle change
discard 5f54ed5e677 [TIMECHODB] fix distribution with ainode
discard c5794ac227e Add ainode to distribution (#14092)
discard 827078f7d92 Pipe: Pin unpin log frequency decrease (#14049) (#14076)
discard 1bb9a0f3e85 [To dev/1.3] Add cache hit situation and actual io size
for BloomFilter, TimeSeriesMetadata(including ChunkMetadatList) and Chunk
(#14082)
discard 29e83001ebd Pipe: Fixed the bug that historical aligned timeseries'
attributes/tags/alias is not transferred (#14071) (#14078)
discard 40202f66897 Pipe: Fixed the bug that historical aligned timeseries'
attributes/tags/alias is not transferred (#14071)
discard d210a860b30 Subscription: avoid the file reading when the memory is
not enough for tsfile slicing & implement all-out effort global timeout control
& support client resume from breakpoint for tsfile consumption (#13992) (#14072)
discard bcd6374ca99 modify stop node scripts (#14056)
discard 025d71aa07c Pipe: Fix the null pointer caused by uninitialized
TabletInsertionEventParser LocalDate and Binary arrays (#14058) (#14068)
discard 0a0c7be07b9 Pipe: atomically publish segment lock to avoid
uninitialized volatile variable (#14064) (#14066)
discard ae61cec365c Pipe: avoid supply event with failed tsfile resource pin &
apply double-checked locking for exists-and-mkdirs operation (#13998) (#14065)
discard 9895a2e2d59 [to dev/1.3] Modify default heap dump path of datanode
(#14061)
discard 2d218fac2ae [region migration] Fix tsfile error caused by target
DataNode's fast rebooting #14031 (#14054)
discard cea18612b6a Remove useless log "datanodeId -1" #14035 (#14055)
discard 8fc30f47df8 Pipe: CreatePipe and AlterPipe support now function
(#14014) (#14037)
discard 8ec65962b4c bump ratis to 3.1.2 (#14046)
discard c6a3a5bd979 Change typo in warn log for disk_space_warning_threshold
(#14042)
discard 4b38a21625d [To dev/1.3] Fix query resource clear async thread stuck
bug
discard 1a55856c0f4 Fix concurrent problem (NPE) of AsyncRequestManager
(#14004) (#14034)
discard 7e28194f9d7 Pipe: Update tsfile version to fix the issue that the time
of the first data item written to TSFile by measurement cannot be a negative
number (#14033)
discard 21022b1f3f6 [To dev/1.3] Pipe: Fix the null pointer and unreasonable
default Empty LocalDate caused by TabletInsertionDataContainer (related to
#13990) (related to #14014) (#14025)
discard 46f6e00eba6 Pipe: GC device2Measurements in PipeRealtimeEvent in time
to avoid OOM when insertion is in high load (#14018) (#14023)
discard 9223b7df2ec Pipe: Fixed the bug that the
PipeDataNodeRemainingEventAndTimeMetrics may generate NullPointerException
(#14015) (#14024)
discard 2a3da34e009 [To dev/1.3] Bump version to 1.3.4-SNAPSHOT
discard 991dfd50c8b [To dev/1.3] Add github action for dev/* branch
discard fc6cfe555c8 [TIMECHODB] change .gitlab-ci.yml to support dev branch
discard 258806ce815 [TIMECHODB] change master_merge_helper.sh
discard 1fdfded525a [To rc/1.3.3] Print Dataset is closed error msg if user
continues to fetch from it
discard a7411ce1bba [to rc/1.3.3] Fix DeleteDatabaseProcedure (#13927) #13973
discard b1dfa4962ce Pipe: Optimize lock in PipeTsFileResourceManager using
segment lock strategy (#13915) (#13994)
discard d0d8db1315d Pipe: Add fsync option for file receiver to avoid data
region unexpected behavior after system restart (#13984) (#13993)
discard 5db61aa1810 [To rc/1.3.3] Combine CSV SQL TSfile data import/export
script (#13930)
discard 10656f6586a Pipe: Avoid the file reading when the memory is not enough
for tablet parsing (#13954) (#13988)
discard 2ecb809835c AINode: Fix built-model inference error (#13986)
discard a2eb8c0cead [To rc/1.3.3] Correct the memory estimation for
SeriesAggregationScanOperator
discard 06cd00f3ba6 Subscription: intro memory control when constructing file
payload to avoid OOM (#13937) (#13977)
discard 99e5d7b21c2 Subscription: implement resource-aware and request-aware
dynamic prefetching logic (#13956) (#13976)
discard 4b378d7b612 Subscription: avoid endless loop when fetching subsequent
responses by poll timer (#13968) (#13975)
discard 23ef8600c9e [to rc/1.3.3] Fix negative mods file metric (#13970)
discard de8fa60fa2e [TIMECHODB]Update do-docker-build-enterprise.sh
discard 6650dedfb5a Pipe: Disable sloppyPattern in
PipeHistoricalDataRegionTsFileAndDeletionExtractor (#13934) (#13957)
discard a960c3a3788 [To rc/1.3.3]Fix IoTV2 metric NPE due to concurrency #13952
discard f9b1e1fb4b9 [TIMECHODB][to rc/1.3.3][Activation] System Info V02
(support L4 again)
discard 0d501a18380 [to rc/1.3.3] Reduce deserialized file num in compaction
validation (#13944)
discard 225e0dd54fb Pipe: validate all pipe parameters before alter (#13932)
(#13958)
discard c3a9aaf663a [to rc/1.3.3] Modify message of unsupported
DataNode->ConfigNode RPC (CP 13945) #13948
discard 4b50e85c957 [region migration] Retry WRITE_PROCESS_REJECT status code
#13921 (#13924)
discard 361ee29914c fix negative file metric items (#13943)
discard 6bfcc8ba031 Fix the case that there is nonexist measurement in having
clause
discard 0ca8d5cf9a1 [TIMECHODB][to rc/1.3.3] CLI Activation
discard 302985b7a4b [To 1.3] Batch update inserted point number metric (#13939)
discard 29bc36cfabf Pipe: Support specifing receiver's username and password
when syncing data between clusters (#13933)
discard b29ab52ff97 Subscription: implement subscription event optimistic
transmission strategy to reduce peak memory usage (#13763) (#13928)
discard 2510e040e5f Subscription: improve subscription meta management with
sub-procedures strong exception handling semantics (#13698) (#13923)
discard 05b1d55a973 [TIMECHODB] fix CnToDnAsyncRequestType
discard 8b0298bb49d [to rc/1.3.3] Split CnToDnRequestType to sync and async &
Add check for adding new request type (see #13660) (#13784)
discard 63497d63a30 Pipe/Subscription: avoid executing
`rollbackFromValidateTask` or `rollbackFromValidate` multiple times in retry
with rollback scenarios (#13825) (#13916)
discard 49802a6ae08 [to rc/1.3.3] Fix compaction cached time chunk flip twice
(#13904)
discard 97767bcc93d [region migration] Enable write retry for ratis local
write (#13901) (#13913)
discard 64c48144a88 Active Load: Refactoring the code for handling exception
information after loading failure (#13880) (#13897)
discard 1e1038145fe Pipe: Avoid constructing unnecessary pipe subtasks if db
and pattern dismatch (#13873) (#13892)
discard d372dcc328b fix DirectoryNotEmpty (#13710)
discard f71292e37d8 Fix TimePartitionUtils Overflow (#13881) (#13885)
discard e88fd1ffc5f Pipe: fix calculations of
PipeDataNodeRemainingEventAndTimeOperator (#13876) (#13889)
discard f4a713b81cb [To rc/1.3.3] Fix the cache invalidation logic in
RouteBalancer
discard a5a9dff89f7 Active Load: Adjust the default execution thread to match
the number of CPU cores (#13865) (#13872)
discard 66cfcfb78ea Pipe: Remove already deleted tsfile resource from
historical extraction list to prevent FileNotFoundException (#13869) (#13874)
discard d3ed46a3d63 Pipe: Reduce Calculations for
PipeDataNodeRemainingEventAndTimeOperator when the events are too many (#13854)
(#13870)
discard db91d55213c [To rc/1.3.3] Print file path while meeting unknown
version tsfile
discard 9f571776fb3 [to rc/1.3.3] Fix the issue that tasks with negative
estimated memory are executed (#13857)
discard c9419d1f346 [to rc/1.3.3] Fix compaction task comparator bug & Modify
target file name of inner compaction task (#13849)
discard 7da52e7e3cb Active Load: Fix scan tsfile do not close the stream
resource (#13846) (#13852)
discard a27ffb1dd3a [TIMECHODB][To rc/1.3.3] Bump ratis to
3.1.2-b09bfe7-SNAPSHOT
discard 43062790ced [To RC/1.3.3] Metric: Discard Error Metric When Taking
Snapthot (#13844)
discard 8d878b49406 Pipe: degrade progress index rebind log (#13821) (#13826)
discard e35e82ae7cd Active Load: Fix load tsfile failed when system is read
only and not have the error message. (#13805) (#13816)
discard e1f227ccc64 [To rc/1.3.3] [Fix] fix writing fail in ratisConsensus due
to retry policy condition mismatch #13811
discard f07213db555 Subscription: declare the referenced code for timer in
license & fixup committable logic for ack (#13795) (#13801)
discard 085688bc3cd Subscription: improve event consistency by operating
within the `compute` method (#13787) (#13794)
discard 7c53805b148 AINode: add retry logic in model status check in AINode IT
(#13774) (#13786)
discard 1840a129f6c [to rc/1.3.3] Add time chunk cache for batched column
compaction (#13772)
discard 22a438f2143 fix compaction logger no such file or directory (#13780)
discard cdbc48e2a79 [Py-client] Fix dataset contains null value contract error
(#13762) (#13767)
discard c3cbd30d733 [To rc/1.3.3] change metricLevel to important #13770
discard 82cb24e1e5f Extend the startup waiting time of AINode in CI
discard c85a452e537 [TIMECHODB] [to rc/1.3.3] Fix compilation error
discard 884f4392539 add metrics (#13766)
discard 9923e8f34a2 fix npe (#13736)
discard 9e138795354 Fix division by zero when querying only ID and attribute
columns in table model (#13758)
discard 0b3c98a78b5 improve write_retry_policy in RatisConsensus (#13761)
discard c3ca4245ca2 [TIMECHODB] bump ratis to 3.1.2
discard ec97f3b0d50 Update DataNodeInternalRPCServiceImpl.java (#13708)
(#13746)
discard 1066fb70607 Load: Fix tsfile that was failed to load exceptionally
deleted by LoadTsFileScheduler (#13705) (#13751)
discard 8e8e13bfe7c Pipe: register aligned timeseries for each device id with
schemas exactly once (#13715) (#13750)
discard 71efc41e1b1 Pipe: fetch isAligned info from
TsFileInsertionScanDataContainer when constructing converted tablet insertion
stmt (#13724) (#13743)
discard 0acdc769cdf Pipe: omit region id when marking collect invocation count
for remaining time calculation (#13673) (#13748)
discard 6575f20622e Subscription: downgrade pipe timeout exception occurred in
procedure for subscription-side & enlarge message invisible time default
parameter (#13685) (#13749)
discard fb2115a29ff Pipe: Fixed potential NPE of iterator / Skipped retry when
when failed to start (#13701) (#13747)
discard 73bf9b42ca4 Fix invalidateSchemaCacheOfOldLeaders() requestIndex
problem #13734 (#13742)
discard 116090c442b [TIMECHODB][TIMECHO] Fix NullPointerError when registering
AINode
discard 43117c29e82 Pipe: Fixed the sequence of "open" and "close" for
confignode inclusion alter (#13688) (#13738)
discard d99fa9461b6 Pipe: Fixed the inclusion options of
schema.timeseries.ordinary.drop (#13687) (#13741)
discard 98f4ee26ae3 Pipe: Avoid type conversion if error on receiver is caused
by insufficient memory (#13569) (#13723)
discard 28bb9378a79 IoTDB-881. Client writing exists partially failures
(#13721) (#13739)
discard 23cb070d37f StateMachineProcedure getCurrentState() return null if
state is EOF_STATE (#13704) (#13732)
discard 423532ab141 Fix the failure of update cluster name in metric framework
of ConfigNode (#13681) (#13733)
discard bc28581713a fix compaction file metrics (#13692)
discard de26e704f05 [TIMECHODB][TIMECHODB] [To rc/1.3.3] Bump ratis version
to 3.1.2-SNAPSHOT
discard 15675f369a4 Catch Exception to improve the robustness of loading
procedure #13696 (#13699)
discard a0e4b41b1d8 Fix the order of stop schema region and clear schema
engine #13678 (#13690)
discard 114ddf28779 [to rc/1.3.3] Fix ttl bugs (#13671)
discard 7ac8b542c4c Active Load: Fix load tsfile failed when system is read
only (#13646) (#13680)
discard 15c3457b9a6 AINode: depend torch of cpu version (#13670) (#13679)
discard 5c1857bfb22 [TIMECHODB] Update pyproject.toml
discard a5752a416e5 Pipe: fix NPE in SessionUtils Binary/Date value
serialization called by TsFileInsertionScanDataContainer (#13654) (#13667)
discard a691567b70c Pipe: Fixed the bug that timeChunk
TsFileInsertionScanDataContainer can be used only once (#13656) (#13664)
discard fcef0d4b420 Pipe: fix npe when discard events under some cases (#13666)
discard b6f4f64f4e4 Fix unexpected column order in ExportTsFile when wildcard
is not used (#13663)
discard 26c44341801 [Config-properties] Change
iot_consensus_throttle_threshold_in_byte = wal_throttle_threshold_in_byte for
compatibility (#13652) (#13657)
discard 20a122d0b7e Fix print error log when dir is not exist (#13591) (#13658)
discard a0cae45d170 [to rc/1.3.3] Invalidate schema cache when data region
leader change (#13585) (#13659)
discard 461f97525c5 Adjust procedure's default clean interval #13648 (#13655)
discard 48f6baf6757 [TIMECHODB]更新.gitlab-ci.yml文件
discard a4ded732154 [to rc/1.3.3] Enhance repair compaction & exception handle
with full disks (#13613)
discard a98c7e8e18b [To rc/1.3.3] Make each execution acquire a schema read
lock only once
discard 905086ad005 Pipe: Fix the problem of missing precision when converting
String type to Int32 and int64 types (#13643) (#13645)
discard 6c5f2614d87 PipePlugin: Add pipe consensus related plugins to
blackList (#13642) (#13644)
discard 4d1f11587c5 Fix NodeInfo processLoadSnapshot method (avoid
compatibility issues caused by ainode serialization) (#13622) (#13637)
discard 66c22574917 Use CountDownLatch to replace Semaphore in IoTConsensus
log dispatcher closing #13517 (#13638)
discard 5f02f9d1e93 AINode: Correcting the Omissions and Redundancies (#13636)
discard ffd4c71718c [To rc/1.3.3]Change the error infomation when insert a
timestamp over Long.MaxValue && Fix potential NPE when write FileTimeIndexCache
(#13633)
discard 1fec2dd59a7 [To rc/1.3.3] Tolerate ser/de call for
configPhysicalReadPlan #13628
discard fe4d4acb760 [To rc/1.3.3] [RatisConsensus] Bump ratis version to 3.1.1
#13630
discard 4b408fa9a78 Pipe: Fixed the bug that different types in schema
snapshot transfer may cause transfer failure (#13627) (#13631)
discard 536e01070cc Pipe: Fixed the bug that alter source will not alter the
reference count of ConfigRegionListeningQueue (#13626)(#13632)
discard 57cd47807cd [To rc/1.3.3] Cherry pick 9903702
discard b1497ba2470 [region migration] Catch Ratis Read InterruptedException
#13612 (#13625)
discard 1d1ab2922bf Load: Fix the source parameter of the load tsfile script
cannot specify a file (#13619)
discard e1cbf7223ea Subscription: register metrics to count the number of pipe
events in sink queue and prefetching queue in subscription task (#13618)
discard 376cf51601a [To rc/1.3.3] Fix the issue that some ut can not stop
(#13615)
discard 8d4b372b7f9 Pipe: Fix relative path in SSLConnector trustStorePath is
not formulated & Fix inclusion option 'delete' fails to parse (#13580) (#13616)
discard 44f83c189ed Pipe: Added count-point-processor to black list (#13606)
discard adb121f0d2c [to rc/1.3.3] Fix flush chunk check in read chunk
compaction (#13539)
discard 19e53407af9 Update tsfile verison to 1.1.0-240924-SNAPSHOT (#13598)
discard 20a10b17818 [to rc/1.3.3] Skip the file timestamp check of tsfiles
generated by repair task (#13582)
discard 2a18108346c Make log dispatcher stop in parallel #13588 (#13595)
discard 4f80e0cea52 fix bug (#13589)
discard a217a75a16d [To rc/1.3.3] Refactor: Removed the useless Ser/de logic
in configNode read plans (#13586)
discard 5a98bd0f4b4 Pipe: Refactor pipe related packages (#13578) (#13584)
discard a0e1882c5d1 Subscription IT: explicitly declare `setUp` method for
test class to avoid `UNKNOWN-IT` test class name (#13576)
discard de8217dc676 Pipe: make progress index immutable (#13571)
discard 6e1785703ed [IOTDB-6351] Don't retry if operation has already succeed
even if the DN is not running status
discard f245d18c533 [To rc/1.3.3] Don't print warn log for sort tmp file delete
discard 360925b5d7b Pipe / Subscription : Fixed the bug that
TsFileInsertionScanDataContainer may use wrong isMultiPage flag for aligned
chunk when value chunk is not continuous (#13554) (#13566)
discard c2006eab34e Pipe: optimize the 'Create Pipe' SQL statement to allow
omitting 'With Sink' when no Source or Processor attributes are defined.
(#13534) (#13563)
discard 349043cbcdd Pipe: Fixed the bug that the relative path in
OPCUAConnector security dir is not formulated (#13555) (#13564)
discard 9b641fa4ade Pipe: eliminate progress index for raw tablet event to
avoid endless rebind (#13567)
discard 9e1b0ae9cf3 [to rc/1.3.3] Fix fill aligned chunk metadata by schema
list (#13558)
discard 71da29d8168 Fix AINode status error after ConfigNode Leader restarts
#13547 (#13556)
discard a8e472c8f98 [To rc/1.3.3] Modify regionMigrateService's ThreadPool to
IoTThreadPoolFactory.cachedThreadPool (#13551)
discard a9ab12a14b3 Load: New SQL grammer -> LOAD <filePath> with ('k'='v',
...) (#13553)
discard 07eecd21a38 Fix print a log every time startup and error exception
handling (#13545) (#13546)
discard 54fed38f0f3 [To rc/1.3.3] Fix the issue of restarting DataNode to
clean up InvalidDataRegion (#13543)
discard cee507d4a0f Pipe: Fix startup failure of
PipeHistoricalDataRegionTsFileExtractor due to unprepared StorageEngine
(#13526) (#13540)
discard 9f2d3dcbd24 Pipe: Fix the Out of memory problem in WALInsertNodeCache
memory management under extreme conditions (#13538)
discard 15f025a7dad Pipe: Fix data lost when syncing between clusters cause by
senders' data region leader change (#13532) (#13536)
discard 838a21b34d9 Pipe & IT : Refactor pipe / IT and improved IT behaviour
(#13530)
discard 26f1d65f8be Pipe: fix event counter decrement operations to avoid
inconsistent final counts (#13533)
discard 6efa4ad9c02 Pipe: rebind progress index to prematurely flushed tsfile
insertion event to avoid data loss when syncing data between clusters (#13519)
discard a11cccb5107 Fix memory calculate error when insertRecords with both
aligned and non-aligned devices (#12720) (#13527)
discard f863d698076 [TIMECHODB][to rc/1.3.3] Print some log in
ActivationVerifier to help activation fail debugging
discard aaf8a94cb14 [Metrics] Fix the grafana panel display error caused by
not initializing trigTime (#13496) (#13524)
discard 145a484cf37 Active Load: Fix load_active_listening_max_thread_num or
load_active_listening_check_interval_seconds less than 0 throwing exception
(#13518)
discard 19f491bfe8b Pipe: Add 'data.delete' & 'realtime-first' conflict check
in PipeParameters (#13514)
discard 04455fc747c [To rc/1.3.3][Py-Client] support new data types (#13506)
discard f09fc8f5613 Fix the logic of catch ServerNotReadyException to enable
read retry (#13509) (#13513)
discard 6297184be88 Active Load: Fix load failures due to memory constraints
not be reloaded (#13510)
discard 04537688695 Pipe: Fixed the bug that certificate cannot be trusted in
OPC UA connector (#13495) (#13508)
discard 51c3da20461 Pipe: Fix asynchronous connector manager leak when the
receiverAttributes exists on constructing (#13501) (#13507)
discard eba6bc1aa7e Fix error in last query with sort + limit
discard 983dd6fe7a5 Pipe: perform deep copy for incoming progress index when
constructing and updating progress index & fix hash code of progress index
(#13441) (#13503)
discard 1c7b50fcf27 Active Load: Check dir r/w permissions before loading from
listening dirs (#13488) (#13500)
discard a56544f5194 Active Load: Fix load_active_listing_enable &
load_active_listing_dirs hot load failure (#13491) (#13499)
discard 4d29673794c Load: add detailed exception message in rpc returned
status (#13493) (#13497)
discard b4eaecd6873 [to rc/1.3.3] Fix the allocation of target file name in
repair data task (#13492)
discard c2242fff188 [to rc/1.3.3] Remove redundant closing of consensus layer
in DataNode shutdown process (#13485)
discard 87b1f427426 fix last time check (#13480)
discard 61b2eee2a3d [to rel/1.3.3] Rename IoTDBShutdownHook to
DataNodeShutdownHook & Delay the execution of the “clear lock file” step in
DataNodeShutdownHook (#13482)
discard fd4f1dbc2d8 Support dictionary encoding for STRING & refactor encoding
support condition (#13473)
discard 320a5424719 Pipe: Remove and close asynchronous connector manager when
all clients are useless (#13399) (#13476)
discard e9638367b68 [TIMECHODB] Resovle missed conflict in AINode
discard ad340dd9210 [TIMECHODB] Remove redundant match logic for AINode
discard 8d2d74036c3 AINode: Refined architecture for enhanced modularity &
Added basic IT (#13423) (#13470)
discard 181b438f545 AINode: Fix restart functionality and enhance error
clarity (#13424) (#13469)
discard 5e8b9620f3a [To rc/1.3.3][PY-Client] Fix python client package issue
discard cbde7912578 Pipe: Added conflict detection of params for reusing of
OPCUA server (#13458) (#13467)
discard c66d80c4f89 [to rc/1.3.3] Add deserializeFromWAL and related code for
ContinuousSameSearchIndexSeparatorNode (#13465)
discard 795c9182a61 [TIMECHODB]: update cli pom
discard 1e75a8e2611 fix index out of bound exception in settle compaction task
(#13463)
discard c32371344f4 [to rc/1.3.3] Optimize column batch selection when there
are many value columns (#13457)
discard bc3b4e7acbf Pipe: refactor committer key for event committer after
pipe restart to avoid non-monotonic increase (#13416) (#13459)
discard 250de6e36cb [To rc/1.3.3]Fix deserialize logic for DeleteDataNode
(#13451)
discard 37a65d95a3c [to rc/1.3.3] Fix compaction device info cache (#13454)
discard b1529692b48 Pipe: Tolerate the error of listening queues in cluster
restart (#13434) (#13448)
discard 3be28d588d5 Load: Support remote load in import-tsfile script & Fix:
remote load in import-tsfile script (#13438) (#13439)
discard e5753d8b3ad [to rc/1.3.3] Make the JDK version check in
remove-datanode.bat consistent with other .bat files #13447
discard 0f791e6320e [to rc/1.3.3] Check decoded page size in compaction
(#13432)
discard 7c0c72e1c59 [to rc/1.3.3] Properly handle the case where a single
IndexedRequest contains multiple “delete PlanNode” operations on the receiving
end of IoTConsensus. (#13427)
discard e801699e441 [To rc/1.3.3][Inconsistent copies] Enhance IoTConsensus
Retry (#13431)
discard 50ccef3ebf9 Pipe: Optimized the opc key store behaviour (#13417)
(#13428)
discard efa670f16a1 [to rc/1.3.3] Repair task may create compaction log file
twice in sequence and unsequence dir (#13414)
discard 4b6996dda06 [to rc/1.3.3] Calculate metadata memory when estimate
compaction memory (#13426)
discard 3761b1f98ba clear AsyncTsFileResourceRecoverTaskList after data region
recoverd (#13412) (#13430)
discard eb0c689ca0e Fix error log when drop database or migrate region
(#13398) (#13429)
discard 91da53765a4 [TIMECHODB] Fix repeat clean for AINode
discard 4c8f62c9f5a [TIMECHODB] Modify gitlab ci config for AINode
discard 55ccafc0a35 Introduce IT framework for AINode (#13425)
discard 29658162330 Pipe: Fix TsFileInsertionDataContainer may generate
ClassCastException (#13415) (#13419)
discard 0838252830c Pipe: avoid logging warn when clearing event ref after
releasing the event & minor improve for javadoc (#13371) (#13422)
discard 54983e6651b Subscription: reduce the length of the stringified
subscription event & do not print warn logs for eagerly pollable events
(#13405) (#13421)
discard ebeb170cf37 Change FileTimeIndexCache to region level (#13353) (#13409)
discard fe8baaf9bb0 Fix default authentication of C++ Client (#13372)
discard 2193490b2a5 [To rc/1.3.3] Fix query stuck caused by restarting DN
while doing query (#13407)
discard 8ea26a40a75 fix bug (#13397)
discard 798b59c3379 Fix/1.3.3 removed ip option from config node remove script
(#13403)
discard 20e67711846 Remove unnecessary type cast log (#13393)
discard c5da3cb32f2 Fix client cpp IT on macos (#13394)
discard f2683a9581f [to rc/1.3.3] Fix
IoTDBSetConfigurationIT.setClusterNameTest (wait DataNode's restarting for more
time, and slow down requesting frequency) #13374
discard 14f0b68e314 Pipe: Fixed the bug that OPCUASink's model effect is
reverted (#13377) (#13389)
discard 13968cf9383 [To: rc/1.3.3]Fix WAL Exception catch & support new
DataTypes in QueryDataSetUtils (#13375)
discard 5af8bc3521c Pipe: better memory control for in-memory tablets (#13384)
discard 6933a1ca999 Pipe: add timely consistency check for pipe memory control
(#13354) (#13385)
discard 628f801e2c0 Pipe IT: req size automatic fragmentation integration test
(#13342) (#13383)
discard b78c2699fc8 Pipe IT: Avoid IoTDBPipeTypeConversionIT from creating too
many DataRegions and SchemaRegions (#13378) (#13381)
discard 705c6fd4632 [TIMECHODB] fix dependency issue
discard d7ef2280592 Speed up recover (#13068) (#13345)
discard 98782bc98a1 decrease default direct buffer size in IT config (#13362)
discard b93e25fe482 Active Load: Add metrics for file size and refactor the
code (#13329) (#13358)
discard 5ffa6bf9454 [TIMECHODB] fix ainode it
discard 30abfd19e9f update 3.1.1-0133c90-SNAPSHOT (#13356)
discard fce07ddbf15 Rc/1.3.3 flush cli output (#13355)
discard 93dd61edc15 Pipe: Fix reference count leak when tasks restart (#13250)
(#13351)
discard 2bbd72877a4 Refactor/ai node build update (#13349)
discard 199cd60d4b4 [To rc/1.3.3] Add clusterId check when restarting nodes
(#13346)
discard bc5736b3348 Get root cause to enable read retry #13341 (#13347)
discard ec666de9788 Pipe IT: Fix CI instability issues related to type
conversion on data sync receivers (#13340) (#13348)
discard d7a604b636b Pipe: Convert data types when data sync sink metadata does
not match integration test (#13326)
discard ac832dab1dc Subscription: always return negative TabletsPayload resp
for tablets streaming transmission (#13339) (#13343)
discard 43dfbce9108 [IOTDB-6350] Correct the allSatisfy for InFilter
discard 5774121e257 Fix query stuck while DN restarting & keep quite while
cleaning sort tmp file
discard 3935d264015 [TIMECHODB] Adapt nodeCommandLine refactor
discard 2a3b6985a54 [to rc/1.3.3] Make procedure scheduler ignore successful
procedure (#13330)
discard 2fffd31f79d Feat/updated cli (#13194) (#13331)
discard 0981f6de2d1 [TIMECHODB] format
discard 64c3877682a Fix some issues of compaction (#13316) (#13325)
discard e7700b29e08 Add 'deserialize_resource' metric item in compaction
(#13298) (#13305)
discard 3594f1906ac [To rc/1.3.3] Pipe: Fixed the
TsFileInsertionDataContainerTest (#13323)
discard f87977b2958 [Metrics]: Add metrics for RestApi (#13260) (#13324)
discard 38ea3b6d6e3 introduce AINode to IoTDB (#13303)
discard 5f3163f84a8 Load: Do not auto create series that are completely
deleted by mods (#13318)
discard 2704315361e Active Load: Add scan filtering judgment & Fix failed
directory without hot reload & Log downgrade & Remove rounds for scheduled
tasks (#13310) (#13317)
discard 4ab0a1a7f13 Pipe: Fixed the NPE in TsFileInsertionScanDataContainer
when there are null values in parts of the alignedChunkData (#13306) (#13314)
discard 8d58c11beff Pipe: Support async tsfile load when data syncing between
clusters (#13311)
discard d1002e2b6cc [to rc/1.3.3] Fix TsFileOverlapValidationAndRepairTool
(#13299)
discard 22b1831b73f Pipe: Avoid req size excceeding the thrift max frame size
by slicing the original req automatically (#13290) (#13308)
discard 415e63d906f Subscription: payload size control for poll request &
apply forced tablet for dataset topic & implement strictness timeout by
multiple poll (#13037) (#13309)
discard 8cd21b8b69f Load: Add metrics for active load (#13281)
discard ea900f31b12 [TIMECHODB][TIMECHODB][rc/1.3.3] Remove training module in
AINode (#13126)
discard 239b15d80ee Fixed the NPE of failed internal create timeseries (#13294)
discard 904b767036e Pipe: discard batched events before restarting pipes
(#13284)
discard 072d6022ca8 [Fix] Add another retryPolicy for RatisClient (#13286)
(#13287)
discard 2cc14133e3d [region migration] Enable SchemaRegion write retry when
migrating region concurrently (#13261) (#13288)
discard c4796cfe1c3 [to rc/1.3.3][region migration] Ratis delete local peer
when resetPeerList is called and myself not in correct peer list #13285
discard 545b78f5067 [To rc/1.3.3]PipeConsensus: build separate dir for each
receiver thread. (#13272)
discard c46897447ff [TIMECHODB][to rc/1.3.3] Improve robustness of
IoTDBActivationIT.dataNodeNumLimitSequentialTest
discard 9fe42f57261 [rc/1.3.3] Inner compaction split large target file
(#13188)
discard a15bdd9b62c [TIMECHODB][TIMECHODB] Avoid Thrift download error
discard 0ac3635c168 [TIMECHODB][to rc/1.3.3] Keep ci artifacts for 7 days
discard 976ee162412 [TIMECHODB] Revert "Subscription IT: intro extensive
regression tests from test group (#13225)"
discard 388ca18efd3 [TIMECHODB] Revert "Subscription IT: migrate regression
tests of parameter and permission from test group (#13248)"
discard 403df78c475 Subscription IT: migrate regression tests of parameter and
permission from test group (#13248)
discard fa8710d1a52 [To rc/1.3.3]Make DN wait when CN cluster's leader is not
ready or down. (#13246)
discard bef66e2e206 [region migration] Fix regionRWLock NPE when migrating
region concurrently (#13217) (#13241)
discard 4108b83c4d1 Pipe: Convert tsfile to tablets on data sync receiver when
data type / aligned type mismatch detected (#13239) (#13245)
discard 19553783ae4 Pipe: Fix InternalCreateMultiTimeSeries plan's members may
be altered in SchemaRegionListeningQueue & Alter timeseries for logical view is
not parsed in snapshot transferring (#13237)
discard efad4a8f2ee Pipe IT: Reduce FT runner cost by removing some
manual-create-schema test cases (#13243)
discard c9370bd985c [rc/1.3.3] Reduce aligned series compaction memory usage
(#13135)
discard a4116dfd62a Pipe: Update TsFileInsertionScanDataContainer to support
partially sequential aligned chunks (#13168) (#13233)
discard 61f4c7b2daf hide cli throw about history Exception (#13235)
discard c9a948efa49 RegionMigrate: Fix migrating region with ratisConsensus
cause the region is unavailable. (#13178) (#13230)
discard 2584c9fc432 Subscription IT: intro extensive regression tests from
test group (#13225)
discard d09760676ae Pipe: The DataRegion migration process checks whether the
user pipe has released all related resources (#13183) (#13228)
discard 1cfc3afadcc Avoid the brain split phenomenon in the symmetric network
partition scenario #13221 (#13226)
discard 800e364ea6a [to rc/1.3.3] [region migration] Do RatisConsensus
resetPeerList even if myself not in peer list #13227
discard 9b4482c53dc [TO rc/1.3.3][region migration] Snapshot source file not
exists problem debugging #13220
discard b19e36102bc [TIMECHODB][to rc/1.3.3] Fix
activeFollowerDisconnection2Test
discard fa8d80f7f4e Pipe: Reduced the recover time in cleaning tsFile
hardlinks (#13219)
discard 103449679b7 Eventually consistent heartbeat samples #13210 (#13218)
discard 3ef31beabbc fix action name (#13213)
discard 08c9c12607c Bump swagger version (#13211)
discard 1e9ee7ef52e [region migration] Ignore old region migration procedure
during procedure framework updating #13138 (#13207)
discard 7944058c636 Bump milo.version from 0.6.10 to 0.6.14 (#13203)
discard d5ed325ace0 Optimize action
discard 952b10be773 [TIMECHODB]update ci
discard 6ae0c9f494a Share device info in compaction schedule (#13150) (#13174)
discard 00a01f90727 [To rc/1.3.3][Region Migration]: Clear Invalid schema
region when restarting (#13185)
discard 55773b2fd1e [Region Migration] Wait for all region-related resources
to be released before deleting (#13148) (#13181)
discard 16a78fac759 [Region Migration] Convert a Ratis exception to enable
read retry #13142 (#13166)
discard 194caa19f4c PipeConsensus: Avoid replicate block && Avoid transfer
error when connector is closed. (#13146) (#13169)
discard 33c1c24ce3a Load: Support Datanode actively listening dirs and auto
load tsfile (#13085) (#13170)
discard a0647b840f8 [ISSUE-13155] When having more than one pipeline
subscription and restarting the server, the second subscription ends in a loop
of doom (#13156) (#13160)
discard 29613a3ce71 [To rc/1.3.3] Make fetch schema error more specific and
support retry for TOO_MANY_CONCURRENT_QUERIES_ERROR
discard 0985c6c2fc6 [TIMECHODB] change master_merge_helper.sh
discard 934166f81c4 [To rc/1.3.3]Adaptation of Filter generated by FreeMarker
in TsFile
discard db6dd147e1f [rc/1.3.3] Fix wal file end marker (#13126)
