justinwwhuang opened a new issue, #9094:
URL: https://github.com/apache/inlong/issues/9094
### Describe the proposal
Agent has trigger, job and task to do task management, these three
concepts have no obvious affiliation. It's hard to understand how they work
with each other. Does one task has many jobs or one task has many jobs? What
about trigger?
Agent uses one job profile to store all the file collect infos that
belong to the job. The infos contains basic file infos and the offsets. However
hundreds and thousands of files in one collect task is not uncommon. It will be
a nightmare to all the infos in one record.
Agent unalbe to collect file periodicity, let alone task rerun. But
they are all important functions for agent.
So, the reconfiguration coms. We will have concepts of task and
instance, obvious one task can contains one or many instances. And offset will
be sotred independently. And we will optimize memory and offset manage.
### Task list
- #9089
### InLong Component
InLong Agent
### Are you willing to submit PR?
- [X] Yes, I am willing to submit a PR!
### Code of Conduct
- [X] I agree to follow this project's [Code of
Conduct](https://www.apache.org/foundation/policies/conduct)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
