Why are high school graduation gown colors gender specific?

Graduation gowns are actually not gender-specific. Males and females traditionally wear the same colors on their graduation day.