Sometimes, just restarting the sim improves performance too. It is a darn quirky beast.
Logically speaking, clearing the cache drives additional downloading and disk writes—both are expensive.
Went back and found the link to the thread. A lot of details but a good read and he put a bunch of time into figuring out how things work: