What is a female bard?

A female bard is simply a woman who is a bard. A bard is a professional storyteller, verse-maker, oral historian, and musician, often associated with a specific culture's traditions. So a female bard would perform those same functions, but as a woman. There's no special distinction beyond gender.