Replying to myself now... Well i figured it out, sort of. My IDE, in which i ran the test that failed, used a different output folder for class files than my build script. Somehow this caused a mismatch somewhere. They now use the same folder, and it works.
-- Regards André Risnes