Perhaps you're thinking of a different poem or phrase? Could you provide more information about the poem you're looking for?
For example, you could tell me:
* The specific islands it might be referring to (e.g., Cuba and Haiti)
* The author of the poem, if you know it
* Any lines or phrases you remember from the poem
* The context in which you encountered the phrase "Twin Gems of the Caribbean"
With more information, I might be able to help you find the poem you're looking for.