Fixed the problem, a multiplication with a newly created scale matrix did the trick