Payroll costs the most, followed by travel and transportation, costing taxpayers millions of dollars.