Fifty Shades will "turn on path of destruction" of marriage: Jamie Dornan has turned down a sequel