This is an automated email from the ASF dual-hosted git repository.

jackie pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/pinot.git


    from b787ad43a1 Add CLPV2_ZSTD and CLPV2_LZ4 raw forward index compression 
codecs. (#14661)
     add d953d7cffc Pauseless ingestion without failure scenarios (#14741)

No new revisions were added by this update.

Summary of changes:
 .../common/utils/PauselessConsumptionUtils.java    |  46 +++++
 .../realtime/BlockingSegmentCompletionFSM.java     | 113 ++++++-----
 .../realtime/PauselessSegmentCompletionFSM.java    | 126 +++++++++++++
 .../realtime/PinotLLCRealtimeSegmentManager.java   | 210 ++++++++++++++++-----
 .../helix/core/realtime/SegmentCompletionFSM.java  |   6 +-
 .../core/realtime/SegmentCompletionManager.java    |   2 +-
 .../core/data/manager/BaseTableDataManager.java    |  45 ++++-
 .../realtime/PauselessSegmentCommitter.java        |  73 +++++++
 .../realtime/RealtimeSegmentDataManager.java       |  33 ++++
 .../manager/realtime/RealtimeTableDataManager.java |  96 +++++++++-
 .../manager/realtime/SegmentCommitterFactory.java  |   5 +
 .../manager/realtime/SplitSegmentCommitter.java    |  10 +-
 .../pinot/core/util/PeerServerSegmentFinder.java   |   2 +-
 .../PauselessRealtimeIngestionIntegrationTest.java | 176 +++++++++++++++++
 .../table/ingestion/StreamIngestionConfig.java     |  11 ++
 .../apache/pinot/spi/utils/CommonConstants.java    |   2 +
 16 files changed, 841 insertions(+), 115 deletions(-)
 create mode 100644 
pinot-common/src/main/java/org/apache/pinot/common/utils/PauselessConsumptionUtils.java
 create mode 100644 
pinot-controller/src/main/java/org/apache/pinot/controller/helix/core/realtime/PauselessSegmentCompletionFSM.java
 create mode 100644 
pinot-core/src/main/java/org/apache/pinot/core/data/manager/realtime/PauselessSegmentCommitter.java
 create mode 100644 
pinot-integration-tests/src/test/java/org/apache/pinot/integration/tests/PauselessRealtimeIngestionIntegrationTest.java


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to