You’ll get a bunch of different answers for this one. Some people swear by the cache, others say it has a negative impact on their performance (opposite of what a cache should do) and hurts photogrammetry quality.
The best is to try it for yourself and see how it affects you.
Note that atm, the manual cache is broken from the last update, and trying to cache an area will cause the sim to CTD.