bobbai00 opened a new issue, #4492:
URL: https://github.com/apache/texera/issues/4492

   ### Task Summary
   
   ## Movitation
   
   #4020 introduces a LLM agent that is purely implemented at frontend.
   
   However, this architecture is not scalable mainly because:                   
                                                                                
                                                                                
                                                                                
                                                                                
                                                                                
**Agent lifetime is tied to a browser tab.** Closing or refreshing the tab      
                                                                                
                                                                     
       terminates an in-flight generation, loses intermediate ReAct state, and 
leaks
       any partially-applied workflow edits. There is no way to resume after a  
                                                                                
                                                                            
       disconnect, and a user cannot return to an agent run started on another  
                                                                                
                                                                            
       device.                                                                  
                                                                                
                                                                                
                                                                                
                                                                                
                                                                                
                                                                                
                                                                                
                                                                                
                                                                                
                                                                                
                                                                                
                    
                                                                                
                                                                                
                                                                            
   Therefore, a dedicated micro service is needed for LLM agents management.
   
   ## Proposed architecture
   
   <img width="4012" height="1572" alt="Image" 
src="https://github.com/user-attachments/assets/49987c82-443f-45a0-84cf-72f3f2e10e67";
 />
   
                                         
   
   ### Priority
   
   P2 – Medium
   
   ### Task Type
   
   - [ ] Code Implementation
   - [ ] Documentation
   - [ ] Refactor / Cleanup
   - [ ] Testing / QA
   - [ ] DevOps / Deployment


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to