The full verse is:
"Sing a song of sixpence, a pocket full of rye,
Four and twenty blackbirds baked in a pie.
When the pie was opened the birds began to sing,
Was not that a dainty dish to set before the king?"
It's a rather unusual and humorous image, as blackbirds are not typically eaten!