From Help:
If you don't see the outline symbols , , and , click the Microsoft Office Button , click Excel Options, click the Advanced category, and then under the Display for this worksheet section, select the worksheet, and select the Show outline symbols if an outline is applied check box