Ornstein studied acting as a child at the American Academy of Dramatic Arts in New York City, and later studied under Stella Adler. After high school, he enrolled in the Mason Gross School of the Arts. He quit after his first year and moved to New York City to begin working professionally.