If there is a discrepancy in the date/time behaviour between XLS files and XLSW files, the first thing you should check is if you created the binary reader using one of the methods that has the convertOADate parameter, and set the value of the parameter to true, i.e.
IExcelDataReader excelReader = ExcelReaderFactory.CreateBinaryReader(filestream, true);