Ezra is a scion of the Ezra-Sassoon banking and trading dynasty. His ancestor, David Ezra, was a highly successful businessman in Calcutta, India. Another ancestor, David Sassoon, was treasurer to the Ottoman Empire in Baghdad before setting up in Bombay, now Mumbai, and becoming a British citizen. His mother, from Venice, Italy, was for many years a language coach at Glyndebourne Festival Opera.