Welcome to the Board!
You can do it, but it's a pain in the *** - Unfortunately Excel doesn't like being a text editor like Word. Within the cell, select the "st", "th" or whatever you want, then hit CTRL+1-->Font-->Check Superscript. The characters you selected will then be raised like they would in Word.
If you want an automated procedure for this you'll need some code.
HTH,