Looking stylish in a black t-shirt, shorts, a cap and donning a gold chain, the Biebs gave photographers a shock when they spotted his new tattoo