The point is King was speaking to a black audience about the poor people's campaign and guaranteed income. He knew that many white Americans did not get land, colleges, and whatever you mean by civil servants.

Quote him if I'm wrong.

Also, listen to the clip of him making that explicit 28 minutes into this: https://www.youtube.com/watch?v=vaEYVlGu1ng