I can agree there are undoubtedly a higher percentage of black people who would love for racism to end, but I think you underestimate the number of white people who have had enough of it. I don't have any way to prove that, so I won't argue it, but the history of abolitionism and integration is a history of white and black people working together.
The problem with talking about "anti-racists" is the term was appropriated in the '80s by the Ivy Leaguers who think there is only one way to oppose racism. I can completely agree that many antiracists are sincere. But a famous observation applies to many of them:
"It is difficult to get a man to understand something when his salary depends on his not understanding it." —Upton Sinclair
While I'd feel presumptuous as hell arguing with Muhammad Ali, I would tell him you really want to be precise when fighting snakes. The poisonous ones benefit when you're sloppy.