abhioncbr commented on PR #12866: URL: https://github.com/apache/pinot/pull/12866#issuecomment-2076188853
> I don't fully follow why did it break. Following the same logic in #11857 should work. Basically when downgrading and Pinot doesn't understand the new format, it should try to generate the old format I think, in this case, it's failing because we are generating the [segment based on updated](https://github.com/apache/pinot/blob/99a41803305a39887805e1106f90d07e4b6af978/pinot-compatibility-verifier/src/main/java/org/apache/pinot/compat/SegmentOp.java#L183) Lucene library-based code using codec99, and for [uploading](https://github.com/apache/pinot/blob/99a41803305a39887805e1106f90d07e4b6af978/pinot-compatibility-verifier/src/main/java/org/apache/pinot/compat/SegmentOp.java#L222) using the old library based code. So while, uploading we are getting this error ```bash 2024/04/17 02:28:04.193 INFO [StartServiceManagerCommand] [Start a Pinot [SERVER]] Started Pinot [SERVER] instance [Server_10.1.0.40_8098] at 9.332s since launch 2024/04/17 02:38:12.482 ERROR [LuceneTextIndexReader] [HelixTaskExecutor-message_handle_thread_4] Failed to instantiate Lucene text index reader for column textDim1, exception Could not load codec 'Lucene99'. Did you forget to add lucene-backward-codecs.jar? 2024/04/17 02:38:12.482 ERROR [ImmutableSegmentLoader] [HelixTaskExecutor-message_handle_thread_4] Failed to load segment: FeatureTest1_Segment with SegmentDirectory java.lang.RuntimeException: java.lang.IllegalArgumentException: Could not load codec 'Lucene99'. Did you forget to add lucene-backward-codecs.jar? at org.apache.pinot.segment.local.segment.index.readers.text.LuceneTextIndexReader.<init>(LuceneTextIndexReader.java:101) ~[pinot-segment-local-1.2.0-compat-1713320271.jar:1.2.0-compat-1713320271-1d807df40160ec8525b5a33847d67a61fef2c54e] ``` Do you think it's a valid reason? Also, I think generation of the segment in the compatibility test should also be based on the previous version itself. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org
