The misconception comes from the fact that manga is read from right to left, which is the opposite of how comics are read in most other countries. This is due to the influence of traditional Japanese writing, which flows from right to left and top to bottom.
So, while it might seem like manga is backwards if you're used to reading left to right, it's actually just a different reading order. It's not backwards, it's simply a different convention.