No need to remove it. If you don’t fly around London with photogrammetry on, then you’re fine. If you do fly in London, or large cities with heavy Photogrammetry, like Paris as well, but prefer to have performance you can simply turn Photogrammetry off in the display options.
note: Not all photogrammetry cities and areas have heavy performance hit.