krickert commented on PR #3451: URL: https://github.com/apache/tika/pull/3451#issuecomment-6483269403
So let me know if this approach is clear. It's going to be a similar pattern I use for the grpc output we do for tika in OpenNLP - we'll have a document shape in there that'll get all the RAG folks excited including putting embeddings on the data (I'll build a plugin for you as well that decorates NLP data all over the place in Tika once we release 3.0). That being said, I imagine we would make OpenNLP's enhancements a direct integration, or we can make it so it's either-or (if they want to scale the OpenNLP work, they can use the gRPC and if they want to just directly integrate it they can do that as well). But the idea really falls around SPI and the ability to inject services into java now without reflection. Also, the fact that all protobufs carry the "Message" inheritance. FastWARC's grpc server is a good example - I can see a lot of Tika people having WARC files. But my intent with that parser is just to have a useful example. I can pick another service if you want as a demonstration. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
