villebro commented on issue #2349:
URL: 
https://github.com/apache/datafusion-ballista/issues/2349#issuecomment-5643330380

   Thanks @phillipleblanc for getting this work started. I think this lists the 
necessary prerequisites, but once the public APIs are in place, I’d love to see 
a follow-up epic/milestone where Ballista itself ships support for one or more 
commonly useful shared-state backends. I think if we only enable external 
crates to implement active-passive failover, HA may still be too hard for 
casual operators to actually adopt. For enterprise evaluation especially, it 
would be much nicer if the stock scheduler binary could run in HA mode from 
config/CLI, without requiring a fork or custom scheduler wrapper.
   
   Just as an example, something like:
   
   ```shell
   ballista-scheduler \
     --scheduler-ha-enabled \
     --scheduler-state-backend redis://...
   ```
   
   or equivalent config-file settings.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to