GitHub user ep9io added a comment to the discussion: Further LLM Support
Hi @vdwals, I contributed to the language model chat plugin. š I had a look through your GitHub project and was pleased to see you've implemented a plugin for embeddings. I initially started working on embeddings (for vector searching) and language model APIs (for prompting). My project required more focus on the prompting side, so I managed to complete that plugin, but I left the embeddings plugin unfinished. In my prototype, I used it to compute embeddings using BERT (hard coded). Your version looks far more complete! Regarding "embeddingmodels", as @bamaer said, the more functionality the better. Langchain4J's embeddings would be an excellent addition, and I'd love to try it out someday. Regarding "languagemodels", I noticed that there is some overlap with the existing plugin (in HOP). As your plugin seems to currently support only Ollama, it might be best to integrate any new functionality that your code has into the existing plugin that supports more than just Ollama. Iād be happy to assist with that if needed! Regarding "embeddingstores", that complements the embeddingmodels from what I can see and it has support for in-memory and neo4j, which is great. Regarding "semanticsearch", from a quick glance, that seems to be the plugin that reuses the "embeddingsmodel" meta for obtaining the model to create embeddings from text and the "embeddingstores" for storing those embeddings (vectors). Then, submitting the search request to the store and outputting the relevant matches along with their scores. I do have some follow up questions, but I can ask them in a separate comment. Regarding "tableextraction", I only glanced at it quickly and it appears to be a domain specific task, but has potential to be turned into something others can use. It prompts a model and returns a result, with the result being some form of translation from json extracts into value types. Sounds like something @bjackson-ep was interested in or working with, from what he discussed with me at one stage. Thanks for sharing your repository and the work you've been doing, it's all interesting. GitHub link: https://github.com/apache/hop/discussions/4732#discussioncomment-11716000 ---- This is an automatically sent email for [email protected]. To unsubscribe, please send an email to: [email protected]
