'The X Factor' might not return to screens in 2021, according to ITV's director of television Kevin Lygo.
