How to use the FBW A320neo Moving Map?

You’re in the wrong mode. Select ARC and your problem goes away. Pro tip: read the guides, i.e. the beginner guide: A32NX Beginner Guide - Overview - FlyByWire Simulations Documentation