Alemayehu was born in June 1941 in Addis Ababa, where his father worked as a taxi driver. Alemayehu talent was recognized by Colonel Retta Demeqe, who invited the young singer to perform with Addis Ababa's famous Police Orchestra. He had his first hit "Seul" in 1961 before moving on to found the Alem-Girma Band with Girma Beyene. Over the course of 15 years, Alemayehu released some 30 singles until the arrival of the communist junta Derg. Alemayehu continued working as a musician under the Derg and was once ordered to perform in Korean for Kim Il-sung.