Georgian President Mikhail Saakashvili has dismissed the country's Prime Minister Lado Gurgenidze in a cabinet overhaul following the military operation in South Ossetia.