Australian captain George Bailey believes his side's poor fielding cost them victory in their Twenty20 International against Sri Lanka in Sydney.