Europe “cannot afford the luxury of waiting more to get European defence organised,” said the conference chairman.