The more you are zoomed in the higher "Zoom" is. You said:

the more i'm zoomed in, the more it has to move.
So you could try this:

Moved.X := Moved.X - Vec.X * Zoom;
Moved.Y := Moved.Y - Vec.Y * Zoom;

The ammount of movement now depends on how much you zoomed.

It would be good if you wrote short comprehensible sentences instead of this:

As far as i understand, in this case the distance it moves is allways the same if i keep my mouse steady, as i understand, the more i'm zoomed in, the more it has to move.
I had to read it 4 times to figure out what you ment.