Clicking on the map pin icon under the location column should zoom you into that marker on the map view instead of creating a new map view.
I also have this issue. I don’t understand why clicking the geotag in the location column creates a whole new Map view that isn’t even centered on the address you clicked. It could be a very useful feature but the way it works now is counter-intuitive and not very useful.