Text color, text font type, text size. When I highlighted all and said "Remove Formatting" it took seconds to import. I was dealing with 50,000+ rows, but not many columns.
The source of the Excel file was an export from Business Objects, so the formatting was applied in the report.