The more I think about it, the more it sounds like the apple-pear distinction may refer to the difference in their shapes. I know that human body proportions are sometimes referred to as being apple- and pear-shaped.
Which now makes me wonder how oranges wound up replacing pears here in the US. Their color? Flavor? Texture? Or the completely different climates in which they're grown?