Are you constantly checking if your mouse is hovering above a sprite or only on mousedown?