This is an automated email from the ASF dual-hosted git repository.
hxd pushed a change to branch aggregate
in repository https://gitbox.apache.org/repos/asf/incubator-iotdb.git.
from 98f614d Merge remote-tracking branch 'origin/aggregate' into
threadlocal_for_query
new 77206b2 add autoRepair option for NativeRestorableIOWriter
new 742e686 Merge pull request #93 from apache/jira39
new 2fcc8d2 Added Initial Version of release notes as preparation for the
Release 0.8.0.
new af199ad Merge pull request #91 from JulianFeinauer/add-release-notes
new 7a563c0 update license (#94)
new a0053ac Added autoRepair functionality to TsFileSequenceReader.
new 923b383 Small refactoring.
new f80955d Added exception to TsFileSequenceReader.readTailMagic, when
there is no tail magic.
new 169959c Merge pull request #98 from
JulianFeinauer/feature/IOTDB-39-add-autorepair-reader
new 9b8b68a [IOTDB-49]Remove 2 unneeded logs. (#99)
new 41e3fbe fix doc bug (#104)
new ef46df9 fix bug IOTDB-50
new 5f247c6 Merge pull request #107 from apache/fix_bug_IOTDB_50
new aae9a57 [IOTDB-23] Add monitor statistics of file size. Phase 1.1
(#88)
new a58b084 [IOTDB-56] faster memtable.getSortedTimeValuePairList (#105)
new 7dd3722 [IOTDB-8] Fix filenode restore deserialization (#96)
new 96f3710 rename postback to sync and reconstruct sync client
new 2f2e1d8 reconstruct thrift sync service
new ab830f9 reconstruct sync server
new 47dcea4 test sync function and modify the implementation of singleton
new c165a8f modify shell scripts about sync
new 0a46869 remove author mark
new 0bbf2f3 fix sonar issues
new 59d1ae8 Merge pull request #101 from apache/Sync-Reconstruct
new 5309448 [IOTDB-39]Refactor auto repair for TsFile reader and TsFile
writer (#100)
new 306a681 set SQL parse error as debug level log; fix some sonar issues
new f205900 Merge pull request #112 from apache/fix_jira_62
new bd3a798 [IOTDB-63] Use TsFileInput instead of FileChannel as the
parameter passed to methods (#110)
new e3f9728 call valueDecoder reset() when reading data from a new Page
new a92c7b3 Merge pull request #113 from
apache/fix_jira_67_valueDecoder_reset
new d637989 add check SG for MManager, MGraph and MTree (#114)
new abc189c fix channel close bug in merge process (#103)
new 8829460 check whether tsfile is deleted in ut
new d21409f Merge pull request #116 from
apache/fix_check_whether_file_is_deleted_in_ut
new 0e74fa1 Reorganized the start and close of sync thread
new 6e4bc04 Merge pull request #118 from apache/fix_sync_thread_bug
new 1f626c4 add metadata plan codec
new 6e2dcea add author and loaddata plan codec
new 20d5513 add property plan codec
new e0f265b add physical codec unit test
new 30c89ff Merge pull request #115 from apache/serialize-physicalplan
new edaa5b1 merge with master
The 1571 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.mvn/wrapper/MavenWrapperDownloader.java | 2 +-
.mvn/wrapper/maven-wrapper.properties | 2 +-
LICENSE-binary | 262 -----
License | 86 +-
NOTICE | 507 ++++++++-
NOTICE-binary | 1174 --------------------
RELEASE_NOTES | 39 +
Readme.md | 29 +-
iotdb/iotdb/bin/stop-postBackClient.sh => clean.sh | 28 +-
docs/Documentation/Frequently asked questions.md | 28 +-
docs/Documentation/QuickStart.md | 25 +-
.../UserGuideV0.7.0/4-Deployment and Management.md | 77 ++
example/rocketmq/pom.xml | 10 -
example/rocketmq/readme.md | 10 -
.../controller/DatabaseConnectController.java | 41 +-
.../iotdb/tsfile/hadoop/TSFOutputFormat.java | 3 +-
.../iotdb/tsfile/hadoop/TSFRecordWriter.java | 3 +-
.../iotdb/tsfile/hadoop/example/TsFileHelper.java | 13 +-
.../cn/edu/thu/tsfile/hadoop/TsFileTestHelper.java | 17 +-
...rt-postBackClient.bat => start-sync-client.bat} | 4 +-
...tart-postBackClient.sh => start-sync-client.sh} | 4 +-
...top-postBackClient.bat => stop-sync-client.bat} | 4 +-
...{stop-postBackClient.sh => stop-sync-client.sh} | 6 +-
iotdb/iotdb/conf/iotdb-engine.properties | 14 +-
...ent.properties => iotdb-sync-client.properties} | 11 +-
.../iotdb/db/auth/role/BasicRoleManager.java | 1 -
.../iotdb/db/auth/user/BasicUserManager.java | 1 -
.../org/apache/iotdb/db/concurrent/HashLock.java | 22 -
.../org/apache/iotdb/db/concurrent/ThreadName.java | 5 +-
.../java/org/apache/iotdb/db/conf/IoTDBConfig.java | 26 +-
.../org/apache/iotdb/db/conf/IoTDBDescriptor.java | 24 +-
.../iotdb/db/engine/filenode/FileNodeManager.java | 87 +-
.../db/engine/filenode/FileNodeProcessor.java | 107 +-
.../engine/filenode/FileNodeProcessorStatus.java | 32 +-
.../db/engine/filenode/FileNodeProcessorStore.java | 55 +-
.../db/engine/filenode/OverflowChangeType.java | 31 +-
.../iotdb/db/engine/filenode/SerializeUtil.java | 72 --
.../iotdb/db/engine/filenode/TsFileResource.java | 101 +-
.../engine/memtable/TimeValuePairInMemTable.java | 8 +-
.../iotdb/db/engine/memtable/WritableMemChunk.java | 14 +-
.../db/engine/overflow/io/OverflowProcessor.java | 2 +
.../db/engine/overflow/io/OverflowResource.java | 1 +
...Exception.java => SyncConnectionException.java} | 14 +-
.../java/org/apache/iotdb/db/metadata/MGraph.java | 9 +
.../org/apache/iotdb/db/metadata/MManager.java | 12 +
.../java/org/apache/iotdb/db/metadata/MTree.java | 28 +
.../org/apache/iotdb/db/monitor/IStatistic.java | 5 +-
.../apache/iotdb/db/monitor/MonitorConstants.java | 67 +-
.../org/apache/iotdb/db/monitor/StatMonitor.java | 160 ++-
.../iotdb/db/monitor/collector/FileSize.java | 173 +++
.../iotdb/db/postback/receiver/ServerManager.java | 102 --
.../db/postback/receiver/ServerServiceImpl.java | 701 ------------
.../iotdb/db/postback/sender/FileSenderImpl.java | 510 ---------
.../iotdb/db/qp/logical/sys/AuthorOperator.java | 95 +-
.../iotdb/db/qp/logical/sys/MetadataOperator.java | 39 +-
.../iotdb/db/qp/logical/sys/PropertyOperator.java | 47 +-
.../iotdb/db/qp/physical/sys/AuthorPlan.java | 30 +
.../iotdb/db/qp/physical/sys/LoadDataPlan.java | 19 +
.../iotdb/db/qp/physical/sys/MetadataPlan.java | 26 +
.../iotdb/db/qp/physical/sys/PropertyPlan.java | 20 +
.../iotdb/db/query/control/FileReaderManager.java | 6 +-
.../db/query/factory/SeriesReaderFactory.java | 1 +
.../java/org/apache/iotdb/db/service/IoTDB.java | 8 +-
.../org/apache/iotdb/db/service/ServiceType.java | 20 +-
.../org/apache/iotdb/db/service/TSServiceImpl.java | 12 +-
.../apache/iotdb/db/sql/parse/AstNodeOrigin.java | 1 -
.../org/apache/iotdb/db/sync/conf/Constans.java | 47 +
.../conf/SyncSenderConfig.java} | 74 +-
.../conf/SyncSenderDescriptor.java} | 87 +-
.../iotdb/db/sync/receiver/SyncServerManager.java | 143 +++
.../iotdb/db/sync/receiver/SyncServiceImpl.java | 757 +++++++++++++
.../sender/SyncFileManager.java} | 101 +-
.../sender/SyncSender.java} | 29 +-
.../iotdb/db/sync/sender/SyncSenderImpl.java | 543 +++++++++
.../ILogReader.java => utils/FilePathUtils.java} | 26 +-
.../org/apache/iotdb/db/utils/PostbackUtils.java | 157 ---
.../apache/iotdb/db/utils/PrimitiveArrayList.java | 1 +
.../java/org/apache/iotdb/db/utils/SyncUtils.java | 126 +++
.../org/apache/iotdb/db/utils/TimeValuePair.java | 7 +-
.../apache/iotdb/db/writelog/transfer/Codec.java | 1 +
.../iotdb/db/writelog/transfer/CodecInstances.java | 471 ++++++++
.../db/writelog/transfer/PhysicalPlanCodec.java | 186 +---
.../writelog/transfer/PhysicalPlanLogTransfer.java | 32 +-
.../db/writelog/transfer/SystemLogOperator.java | 8 +-
.../filenode/FileNodeProcessorStoreTest.java | 91 ++
.../db/engine/filenode/SerializeUtilTest.java | 136 ---
.../db/engine/filenode/TsFileResourceTest.java | 96 ++
.../filenodev2/FileNodeManagerBenchmark.java | 2 +-
.../memcontrol/BufferwriteFileSizeControlTest.java | 8 -
.../memcontrol/BufferwriteMetaSizeControlTest.java | 8 -
.../version/SysTimeVersionControllerTest.java | 14 +-
.../db/integration/IoTDBFlushQueryMergeTest.java | 130 +++
.../iotdb/db/metadata/MManagerBasicTest.java | 26 +
.../org/apache/iotdb/db/metadata/MTreeTest.java | 24 +
.../org/apache/iotdb/db/monitor/MonitorTest.java | 66 +-
.../iotdb/db/monitor/collector/FileSizeTest.java | 93 ++
.../sender/MultipleClientSyncTest.java} | 10 +-
.../sender/SingleClientSyncTest.java} | 111 +-
.../sender/SyncFileManagerTest.java} | 84 +-
.../org/apache/iotdb/db/sync/test}/RandomNum.java | 2 +-
.../iotdb/db/sync/test/SyncTestClient1.java} | 15 +-
.../iotdb/db/sync/test/SyncTestClient2.java} | 13 +-
.../iotdb/db/sync/test/SyncTestClient3.java} | 13 +-
.../java/org/apache/iotdb/db/sync/test}/Utils.java | 6 +-
.../transfer/PhysicalPlanLogTransferTest.java | 157 +++
.../{start-postBackTest.sh => start-sync-test.sh} | 0
.../{stop-postBackTest.sh => stop-sync-test.sh} | 0
...er General Public License version 2.1(LGPL-2.1) | 163 ---
licenses-binary/The JSON License | 11 -
licenses/CDDL License 1.1 | 90 ++
licenses/EDL License 1.0 | 11 +
.../Eclipse Public License 1.0 (EPL-1.0) | 0
.../Eclipse Public License version 2.0 (EPL-2.0) | 0
.../The 2-Clause BSD License | 0
.../The 3-Clause BSD License | 0
{licenses-binary => licenses}/The MIT License | 0
pom.xml | 10 +-
.../src/main/thrift/sync.thrift | 26 +-
spark/pom.xml | 5 -
.../org/apache/iotdb/tsfile/io/CreateTSFile.java | 15 +-
.../apache/iotdb/tsfile/TsFileSequenceRead.java | 1 +
tsfile/pom.xml | 13 +-
.../iotdb/tsfile/file/footer/ChunkGroupFooter.java | 10 +-
.../iotdb/tsfile/file/header/ChunkHeader.java | 12 +-
.../iotdb/tsfile/file/header/PageHeader.java | 14 +-
.../file/metadata/statistics/BinaryStatistics.java | 6 +-
.../file/metadata/statistics/Statistics.java | 16 +-
.../{IDataReader.java => TsFileCheckStatus.java} | 12 +-
.../iotdb/tsfile/read/TsFileRestorableReader.java | 70 ++
.../iotdb/tsfile/read/TsFileSequenceReader.java | 245 +++-
.../query/dataset/DataSetWithoutTimeGenerator.java | 2 +-
.../iotdb/tsfile/utils/ReadWriteIOUtils.java | 34 +-
.../apache/iotdb/tsfile/write/TsFileWriter.java | 4 +-
.../tsfile/write/record/datapoint/DataPoint.java | 9 +-
.../iotdb/tsfile/write/schema/FileSchema.java | 3 +-
.../iotdb/tsfile/write/schema/JsonConverter.java | 23 +-
.../write/writer/IncompleteFileTestUtil.java | 61 +
.../write/writer/NativeRestorableIOWriter.java | 181 +--
.../iotdb/tsfile/write/writer/TsFileIOWriter.java | 1 +
.../iotdb/tsfile/file/header/PageHeaderTest.java | 7 +-
.../iotdb/tsfile/read/ReadOnlyTsFileTest.java | 49 +-
.../tsfile/read/TsFileRestorableReaderTest.java | 59 +
.../tsfile/read/TsFileSequenceReaderTest.java | 16 +
.../TsFileGeneratorForSeriesReaderByTimestamp.java | 32 +-
.../apache/iotdb/tsfile/utils/FileGenerator.java | 19 +-
.../apache/iotdb/tsfile/utils/RecordUtilsTest.java | 17 +-
.../iotdb/tsfile/utils/TsFileGeneratorForTest.java | 110 +-
.../org/apache/iotdb/tsfile/write/PerfTest.java | 13 +-
.../iotdb/tsfile/write/ReadPageInMemTest.java | 13 +-
.../org/apache/iotdb/tsfile/write/WriteTest.java | 28 +-
.../write/schema/converter/JsonConverterTest.java | 48 +-
.../write/writer/NativeRestorableIOWriterTest.java | 72 +-
152 files changed, 5855 insertions(+), 4670 deletions(-)
delete mode 100644 LICENSE-binary
delete mode 100644 NOTICE-binary
create mode 100644 RELEASE_NOTES
copy iotdb/iotdb/bin/stop-postBackClient.sh => clean.sh (58%)
mode change 100755 => 100644
rename iotdb/iotdb/bin/{start-postBackClient.bat => start-sync-client.bat}
(94%)
rename iotdb/iotdb/bin/{start-postBackClient.sh => start-sync-client.sh} (90%)
rename iotdb/iotdb/bin/{stop-postBackClient.bat => stop-sync-client.bat} (82%)
rename iotdb/iotdb/bin/{stop-postBackClient.sh => stop-sync-client.sh} (84%)
rename iotdb/iotdb/conf/{iotdb-postbackClient.properties =>
iotdb-sync-client.properties} (91%)
delete mode 100644
iotdb/src/main/java/org/apache/iotdb/db/engine/filenode/SerializeUtil.java
copy iotdb/src/main/java/org/apache/iotdb/db/exception/{SysCheckException.java
=> SyncConnectionException.java} (75%)
create mode 100644
iotdb/src/main/java/org/apache/iotdb/db/monitor/collector/FileSize.java
delete mode 100644
iotdb/src/main/java/org/apache/iotdb/db/postback/receiver/ServerManager.java
delete mode 100644
iotdb/src/main/java/org/apache/iotdb/db/postback/receiver/ServerServiceImpl.java
delete mode 100644
iotdb/src/main/java/org/apache/iotdb/db/postback/sender/FileSenderImpl.java
create mode 100644
iotdb/src/main/java/org/apache/iotdb/db/sync/conf/Constans.java
rename
iotdb/src/main/java/org/apache/iotdb/db/{postback/conf/PostBackSenderConfig.java
=> sync/conf/SyncSenderConfig.java} (54%)
rename
iotdb/src/main/java/org/apache/iotdb/db/{postback/conf/PostBackSenderDescriptor.java
=> sync/conf/SyncSenderDescriptor.java} (52%)
create mode 100644
iotdb/src/main/java/org/apache/iotdb/db/sync/receiver/SyncServerManager.java
create mode 100644
iotdb/src/main/java/org/apache/iotdb/db/sync/receiver/SyncServiceImpl.java
rename
iotdb/src/main/java/org/apache/iotdb/db/{postback/sender/FileManager.java =>
sync/sender/SyncFileManager.java} (63%)
rename
iotdb/src/main/java/org/apache/iotdb/db/{postback/sender/FileSender.java =>
sync/sender/SyncSender.java} (57%)
create mode 100644
iotdb/src/main/java/org/apache/iotdb/db/sync/sender/SyncSenderImpl.java
copy iotdb/src/main/java/org/apache/iotdb/db/{writelog/io/ILogReader.java =>
utils/FilePathUtils.java} (65%)
delete mode 100644
iotdb/src/main/java/org/apache/iotdb/db/utils/PostbackUtils.java
create mode 100644 iotdb/src/main/java/org/apache/iotdb/db/utils/SyncUtils.java
create mode 100644
iotdb/src/main/java/org/apache/iotdb/db/writelog/transfer/CodecInstances.java
create mode 100644
iotdb/src/test/java/org/apache/iotdb/db/engine/filenode/FileNodeProcessorStoreTest.java
delete mode 100644
iotdb/src/test/java/org/apache/iotdb/db/engine/filenode/SerializeUtilTest.java
create mode 100644
iotdb/src/test/java/org/apache/iotdb/db/engine/filenode/TsFileResourceTest.java
create mode 100644
iotdb/src/test/java/org/apache/iotdb/db/integration/IoTDBFlushQueryMergeTest.java
create mode 100644
iotdb/src/test/java/org/apache/iotdb/db/monitor/collector/FileSizeTest.java
rename
iotdb/src/test/java/org/apache/iotdb/db/{postback/sender/MultipleClientPostBackTest.java
=> sync/sender/MultipleClientSyncTest.java} (96%)
rename
iotdb/src/test/java/org/apache/iotdb/db/{postback/sender/IoTDBSingleClientPostBackTest.java
=> sync/sender/SingleClientSyncTest.java} (88%)
rename
iotdb/src/test/java/org/apache/iotdb/db/{postback/sender/FileManagerTest.java
=> sync/sender/SyncFileManagerTest.java} (80%)
rename iotdb/src/{main/java/org/apache/iotdb/db/postback/utils =>
test/java/org/apache/iotdb/db/sync/test}/RandomNum.java (97%)
rename
iotdb/src/{main/java/org/apache/iotdb/db/postback/utils/CreateDataSender1.java
=> test/java/org/apache/iotdb/db/sync/test/SyncTestClient1.java} (95%)
rename
iotdb/src/{main/java/org/apache/iotdb/db/postback/utils/CreateDataSender2.java
=> test/java/org/apache/iotdb/db/sync/test/SyncTestClient2.java} (95%)
rename
iotdb/src/{main/java/org/apache/iotdb/db/postback/utils/CreateDataSender3.java
=> test/java/org/apache/iotdb/db/sync/test/SyncTestClient3.java} (95%)
rename iotdb/src/{main/java/org/apache/iotdb/db/postback/utils =>
test/java/org/apache/iotdb/db/sync/test}/Utils.java (94%)
create mode 100644
iotdb/src/test/java/org/apache/iotdb/db/writelog/transfer/PhysicalPlanLogTransferTest.java
rename iotdb/src/test/resources/{start-postBackTest.sh => start-sync-test.sh}
(100%)
rename iotdb/src/test/resources/{stop-postBackTest.sh => stop-sync-test.sh}
(100%)
delete mode 100644 licenses-binary/GNU Lesser General Public License version
2.1(LGPL-2.1)
delete mode 100644 licenses-binary/The JSON License
create mode 100644 licenses/CDDL License 1.1
create mode 100644 licenses/EDL License 1.0
rename {licenses-binary => licenses}/Eclipse Public License 1.0 (EPL-1.0)
(100%)
rename {licenses-binary => licenses}/Eclipse Public License version 2.0
(EPL-2.0) (100%)
rename {licenses-binary => licenses}/The 2-Clause BSD License (100%)
rename {licenses-binary => licenses}/The 3-Clause BSD License (100%)
rename {licenses-binary => licenses}/The MIT License (100%)
rename iotdb/src/main/thrift/ServerService.thrift =>
service-rpc/src/main/thrift/sync.thrift (64%)
copy tsfile/src/main/java/org/apache/iotdb/tsfile/read/{IDataReader.java =>
TsFileCheckStatus.java} (77%)
create mode 100644
tsfile/src/main/java/org/apache/iotdb/tsfile/read/TsFileRestorableReader.java
create mode 100644
tsfile/src/main/java/org/apache/iotdb/tsfile/write/writer/IncompleteFileTestUtil.java
create mode 100644
tsfile/src/test/java/org/apache/iotdb/tsfile/read/TsFileRestorableReaderTest.java
