I think I have a mental grasp of how I can do this.

I'll obviously have a default overview of a map, depending on where a character enters it, but when they move my drawing routine will just have to shift to drawing tiles ahead in that direction.

Well in my head it seems reasonably simple lol.