Hi, I have added a milvus connector for SeaTunnel, here is the pr link https://github.com/apache/seatunnel/pull/4885. I want to spread the word about this usage in the milvus community, I'd love to do it. So PTAL thanks. --
Best Regards ------------ Liugddx [email protected] David Zollo <[email protected]> 于2023年6月10日周六 17:54写道： > good job, looking forward to your demo show > > > > Best Regards > > --------------- > Apache DolphinScheduler PMC Chair & Apache SeaTunnel PMC member > David > Linkedin: https://www.linkedin.com/in/davidzollo > Twitter: @WorkflowEasy > --------------- > > On Thu, Jun 8, 2023 at 12:23 AM Guangdong Liu <[email protected]> wrote: > > > > Thanks David and Jun for your comments. > > I have developed connectors for milvus and have tested them,The pr is > > https://github.com/apache/seatunnel/pull/4885. > > I created a demo to search book titles by semantics rather than > keywords. I > > imported the data from > > https://www.kaggle.com/datasets/jealousleopard/goodreadsbooks into > milvus > > and used openai's > https://platform.openai.com/docs/api-reference/embeddings > > api to vectorize the book titles, and then entered the hint words to > > search. I will do a share soon and would like to get feedback from the > > community. > > -- > > > > Best Regards > > > > ------------ > > > > Liugddx > > [email protected] > > > > > > David Zollo <[email protected]> 于2023年6月7日周三 12:07写道： > > > > > Hi Guangdong, > > > Thanks for your good suggestion. Supporting AIGC are indeed > > > promising directions for SeaTunnel. > > > Welcome to contribute code if anybody is interested in these projects. > > > > > > > > > > > > Best Regards > > > > > > --------------- > > > Apache DolphinScheduler PMC Chair & Apache SeaTunnel PMC member > > > David > > > Linkedin: https://www.linkedin.com/in/davidzollo > > > Twitter: @WorkflowEasy > > > --------------- > > > > > > On Mon, Jun 5, 2023 at 4:45 PM JUN GAO <[email protected]> wrote: > > > > > > > > Good idea. > > > > > > > > Guangdong Liu <[email protected]> 于2023年6月5日周一 16:38写道： > > > > > > > > > Hi , Seatunnel Devs, > > > > > Currently very popular AIGC(AI-Generated Content) technology > is > > > used > > > > > in many scenarios,the vector database is an indispensable core > > > component in > > > > > some current mainstream usage scenarios.The following is the > > > architecture > > > > > diagram of Chroma as a vector database. > > > > > > > > > > [image: image.png] > > > > > I found that there is currently no solution for importing > other > > > data > > > > > into the vector database, however Apache Seatunnel is very > suitable for > > > > > this, We can access vector database connector for Seatunnel. The > > > current > > > > > list of some mainstream open source vector databases is as follows > > > > > weaviate, qdrant, milvus, chroma. I very much hope that the > community > > > can > > > > > try Seatunnel+AIGC. > > > > > > > > > > -- > > > > > > > > > > Best Regards > > > > > > > > > > ------------ > > > > > > > > > > Liugddx > > > > > [email protected] > > > > > > > > > > > > > > > > > -- > > > > > > > > Best Regards > > > > > > > > ------------ > > > > > > > > EricJoy2048 > > > > [email protected] > > > >
