GitHub user ep9io added a comment to the discussion: Further LLM Support

Hi @vdwals,

I contributed to the language model chat plugin. 😊 

I had a look through your GitHub project and was pleased to see you've 
implemented a plugin for embeddings. I initially started working on embeddings 
(for vector searching) and language model APIs (for prompting). My project 
required more focus on the prompting side, so I managed to complete that 
plugin, but I left the embeddings plugin unfinished. In my prototype, I used it 
to compute embeddings using BERT (hard coded).  Your version looks far more 
complete!

Regarding "embeddingmodels", as @bamaer said, the more functionality the 
better. Langchain4J's embeddings would be an excellent addition, and I'd love 
to try it out someday.

Regarding "languagemodels", I noticed that there is some overlap with the 
existing plugin (in HOP). As your plugin seems to currently support only 
Ollama, it might be best to integrate any new functionality that your code has 
into the existing plugin that supports more than just Ollama.  I’d be happy to 
assist with that if needed!

Regarding "embeddingstores", that complements the embeddingmodels from what I 
can see and it has support for in-memory and neo4j, which is great.

Regarding "semanticsearch", from a quick glance, that seems to be the plugin 
that reuses the "embeddingsmodel" meta for obtaining the model to create 
embeddings from text and the "embeddingstores" for storing those embeddings 
(vectors).  Then, submitting the search request to the store and outputting the 
relevant matches along with their scores.  I do have some follow up questions, 
but I can ask them in a separate comment.

Regarding "tableextraction", I only glanced at it quickly and it appears to be 
a domain specific task, but has potential to be turned into something others 
can use.  It prompts a model and returns a result, with the result being some 
form of translation from json extracts into value types.   Sounds like 
something @bjackson-ep was interested in or working with, from what he 
discussed with me at one stage.

Thanks for sharing your repository and the work you've been doing, it's all 
interesting.

GitHub link: 
https://github.com/apache/hop/discussions/4732#discussioncomment-11716000

----
This is an automatically sent email for [email protected].
To unsubscribe, please send an email to: [email protected]

Reply via email to