You can customize the colors for each individual calendar by clicking the down arrow next to the calendar name and selecting a new color:
That's all there is to it!