TMZ has learned one top campaign official is privately telling at least one mega-donor ... "It's only a matter of time" before Biden bows out.