Not sure whether you have done this (very simple, so you may have) --
It happened to me too. Launched Excel, there was the Reviewing toolbar. Without making any changes to the file I closed the toolbar, closed the file, and quit Excel.
When I re-launched Excel, the toolbar was gone.