What changed is Catholics did not become white. Religion became less important.

And no, Catholics and Orthodox were not marginalized for a short period. Read about the wars between Catholics and Protestants during the middle ages, and especially take note of the extermination of the Cathars.