An infected South Australian man left quarantine and visited several shops and businesses in Adelaide last Sunday.