De Gooyer was raised in a baker's family, born as one half of a fraternal twin. In World War II he worked as an interpreter, initially for the American 101st Airborne, later on for the British Field Security. From 1959 till 1961 de Gooyer studied at an actors school of the UFA in Berlin.