Answering to myself for future reference: I installed fonts-freefont-otf and the problem seems to be fixed. This package is not recommended nor suggested by octave.
I couldn't find a way to configure a different font file as default font. -- Bruno Schneider
