In case any org-babel R users are interested, this package is now basically ready to use, and I've added a Readme on how to use it:
https://github.com/jackkamm/ob-session-async I plan to add more languages, and to eventually contribute this functionality back to org-mode when it's ready.
