That sounds about right. The filtering is sampling the texels from the other side of the texture due to wrapping. Clamp the texture and the artifacts should go away, or at least be minimized.

But then, if you are doing a retro game, you should probably turn filtering off completely. That would give you the pixellated retro look.