In this context, "free" referred not not to remaining a slave but largely not to staying in jail or jail for committing a crime. Even now, many people incarcerated for crimes cannot vote. Just before the 15th amendment to the constitution in 1870, black men couldn't vote for most states https://sexeslive.com/