Using the header option #+OPTIONS: tex:dvisvgm
and customizing org-preview-latex-process-alist, changing the :image-converter property of the dvisvgm entry like so ("dvisvgm %f -n -b min -c %S -o %O") --> ("dvisvgm %f -n -b min --exact -c %S -o %O") solves the issue. This may be a better default for the org-preview-latex-process-alist variable?