Odd FPS

For about 30 minutes the FPS will stay above 40, but then this drops down to around 10 regardless of what is happening in the game. Then if I click off the game onto a 2nd monitor the FPS will increase to about 25-35. As soon as I click back onto the game the FPS reduce again.

Any suggestions?