PEOPLE confirmed the pair were first dating in November 2021, months after Katie Thurston sent John Hersey home during her season of The Bachelorette
