I suspect some would have made similar arguments against the abolition of slavery, against women’s rights, civil rights, etc. There is still human slavery in the world, as well as subjugation of women, racial discrimination, etc. but those things are widely recognized as wrong.