Almost a million fewer bus journeys were taken in the city in the three months after fares were last increased, a report has found.