Good point—I see the argument for putting Garrison with the segregationists, who can be divided between the malicious, like the KKK, and the well-intentioned, like Lincoln for much of his life. I don't really know much about Garrison, beyond admiring him for being an abolitionist who helped Douglass early on.