How to highlight fields that are not stored?

2023-02-13 Thread Shifflett, David [USA]
Hi, I am converting my application from reading documents into memory, then indexing the documents to streaming the documents to be indexed. I quickly found out this required that the field NOT be stored. I then quickly found out that my highlighting code requires the field to

Re: How to highlight fields that are not stored?

2023-02-16 Thread Michael Sokolov
Sorry your problem statement makes no sense: you should be able to store field data in the index without loading all your documents into RAM while indexing. Maybe there is some constraint you are not telling us about? Or you may be confused. In any case highlighting requires the document in its uni

Re: [External] Re: How to highlight fields that are not stored?

2023-02-16 Thread Shifflett, David [USA]
Hi Michael. Thanks for the reply. As I said in the opening statement, I need to move away reading a file into memory before indexing the file.. The use case here is files 2+ GB in size. I thought streaming the file to be indexed is the only alternative to reading the full file in RAM then indexi