Douglass had five children by his first wife Anna Murray, a free black woman from Baltimore who followed him out of slavery in Less than two years after Anna died in , the year-old Douglass married Helen Pitts, his white former secretary, an event of considerable controversy.