Earl Taylor, Sr., was born in Jetersville in Amelia County, Virginia on June 23, 1930 to Elijah and Frances R. (Saunders) Taylor and was the fourth child born to this union. The family lived in Baltimore, Maryland. Upon the untimely death of his father, the family returned to live in the Jetersville, VA area when Earl was a young child.