Born in Gaffney, S.C. in 1945, Medley began boxing at the tender age of seven. Before he was through he had participated in over 200 fights, losing just nine, with 150 knockouts. Medley won 36 Golden Gloves championships and represented the Carolinas in the National Golden Gloves in Chicago, where he was runner-up to champion Terry Pearson. All his accomplishments came before the age of 17. Many times he boxed men as much as 14 years his senior. His coach Roy Turner regarded Medley as a hard worker who loved boxing. He played high school football, wrestled and was a member of the track team. Medley also played semi-pro football.
He is active in his church and has received two community service awards, as well as spending time coaching boxing and other sports in his community. Medley has served on the Cherokee County Sports Commission. He was a pipe fitter, welder and boilermaker at Hoechst in Spartanburg for 37 years.