Grimes was born in New York City. His acting career began at age seven, during the depression, when he helped earn money for his family. He appeared as Jackie Grimes in the Broadway play The Old Maid, which won a Pulitzer Prize and ran for 10 months in New York. It then went on tour for another 11 months.