"American Idol contestant Caleb Kennedy will no longer be moving forward in the competition," a source close to the show tells PEOPLE
