This book, published in 1986, tells the story of a family whose house, quite literally, walks away and takes them on a wild adventure. They encounter various characters and situations, some of which are quite bizarre and humorous. While it doesn't specifically mention "natives" on an island, the overall tone of the story fits the description you've given.
If this isn't the book you're thinking of, please provide more details, such as:
* What was the art style like? (Realistic, cartoonish, etc.)
* Did the family have any specific names?
* What was the main plot point or conflict in the story?
The more information you can provide, the better I can help you identify the book you're looking for!