You can use any scheduling tool (CRON, RunDeck, etc.) ! Isn't that great?!?!?
In your tool of choice, you will just need to ensure the tool can perform an HTTP Post request with the correct parameters. I personally use the async web service for long running batch jobs and use Python Flash to build a simple dashboard to monitor, but you could do the same with RunDeck, Nagios, or other tools. https://hop.apache.org/manual/latest/hop-server/async-web-service.html The Execution service which is what most of us use is detailed here: https://hop.apache.org/manual/latest/hop-rest/index.html#_execution_services *Where that doc page needs to be improved and provide links from the other pages of Workflows and Pipelines.* Especially at least a tip or note admonition on this page: https://hop.apache.org/manual/latest/pipeline/pipelines.html We're not very good with providing linking to other parts of the manual that are directly relevant to Pipeline or Workflow running. PR's welcome! Anyways, here's the web service metadata directly. https://hop.apache.org/manual/latest/hop-server/web-service.html Also, you can even control the Hop Server itself through scripts that also could be scheduled with your tool of choice. https://hop.apache.org/manual/latest/hop-server/index.html Luckily, you can use the "Search the docs" input box in the top right of the manual in order to find some of the other pages that you might be interested in. Thad https://www.linkedin.com/in/thadguidry/ https://calendly.com/thadguidry/ On Sun, May 14, 2023 at 4:03 AM Mikhail Khludnev <[email protected]> wrote: > Hello, > Thank you for the nice project. This is what I need. I want to reassure my > understanding of scheduling. If I need to run pipeline/workflow on a > regular schedule, is there any other option beside of Airflow (kicking of > hop pipiline) and scheduling it as Dataflow job? > > -- > Sincerely yours > Mikhail Khludnev >
