In the game dialog box that pops up, select the "Options" button on the toolbar at the top of the window.

Then, in the Settings Game Updates and Options window that pops up, click the Clear Information button or uncheck the box in front of Collect information about recently played games, and click the OK button to exit.

With these simple steps, you can clean up the cache files that come with playing a game.