
But here is a recent episode I did find intriguing. It bears on the honesty and built-in bias of some popular online ratings sites. Short version of the story:
- My wife and I knew for months that we would be coming to LA for a week at Christmas time, to see relatives and friends. Rather than just stay in a hotel, we thought we should try something from the burgeoning small-B-and-B category. After poring through online listings and comparing reviews, my wife came up with what looked like a funkily nice one. It was called PAH, the Palisades Art House, in Pacific Palisades, and the reviews were uniformly positive, for instance from AirBnB and VRBO [Vacation Rentals By Owner]. We made the reservation for Dec 23-30; wired the nonrefundable 50% deposit; and in mid November got a confirmation note from the German owner-manager saying "All is set" and that he was looking forward to seeing us.
- When we arrived, at 10pm West Coast time on Dec 23, that same manager looked at us in puzzlement. To jump to the end of the story: he had "forgotten" or "gotten mixed up" about our booking, had sold the room to someone else, and had no space whatsoever for the next week when we were supposed to be there.
- This was inconvenient, especially late on Friday night of a holiday weekend after 12 hours of travel from the East Coast; but worse things happen every day. We called friends and relatives and have ended up staying in their houses, which has been fun. We made the manager give us our deposit back on the spot.

A few days later, I received messages from VRBO, VacationRentals, and HomeAway (which turn out to be three different branches of the same operation, based in Austin), all saying that the review didn't meet their standards and would not be posted. Why? Because they accepted reviews only from people who had stayed at the property; and since we hadn't stayed there, we couldn't comment on the place.
!!! The fact that we couldn't stay there was the point of the review. So I wrote back to the VRBO [etc] service division saying: My problem was that we couldn't stay at the site after we had a confirmed reservation to do so. Isn't this relevant information for future travelers?
Someone from the VRBO staff wrote back, with this [patently false] reply, emphasis added:
Guests can only leave a review if they stayed at the property. Since reviews are meant to be about the property, and not the owner, if you did not stay there you cannot submit a review. We understand that dealings with the owner are an important factor in renting a vacation rental. Since the property is what is advertised on our site, reviews need to be about the physical property.

This is info that VRBO / HomeAway / VacationRentals are aware of and deliberately choose not to share with prospective travelers -- and that AirBnB makes impossible for someone with a problem like ours to post. Let me say this again: the VRBO group knows of a real management problem at a site, and they deliberately choose not to share it -- while freely sharing the 5-star "great host!" ratings. For all I know, this could have happened before, and VRBO etc might have suppressed previous reports of the same problem. (Alex the manager did tell us that night "I've been doing this for a year and a half, and this has never happened to me before," fwiw.)
I recognize that the wide-open nature of Yelp can lead to a bias in favor of whiners, as Derek Brown argued on our site recently. But in this case, whose bias do you prefer? That of Yelp, which opens the microphone to everyone and gets a lot of excessively critical commentary? Or that of a family of sites that knowingly withhold information that might change the uniformly 5-star rating of one of their clients but would also inform their ostensible customers, the traveling public? I will look at reputational media with a cannier eye.






