Jacquie dropped by Macaulay to say hello to me in person the other day. We had a nice chat, and at one point I asked her about whether she and her classmates used RateMyProfessors in deciding what classes to take.

She told me that most students do at least check it, but she also told me something else that matched nicely with a subject I wanted to bring up for this unit (it’s covered in my “Three Stars and a Chili Pepper” essay which is one of the readings, too).

Jacquie told me that she looks at the RateMyProfessors ratings, and puts them through a kind of filter–if they’re all caps and full of misspellings, she figures they’re not very reliable and probably just the work of a student who gave a bad review because he did badly in the course.

A big part of google-fu and learning to ask is not just finding information, it’s evaluating it.  It’s essential, if you’re going to use search as a powerful act, to know when to trust a wikipedia article, or an Amazon rating, or a TripAdvisor review…or a class evaluation on RateMyProfessors.com.

We all have our filters, and the best google-fu masters use the best, most finely-tuned, filters.  It’s possible that this is (another) area where we need to do better with teaching college students (or younger).  It’s certainly not enough to say “oh, you can’t trust those at all.” And it’s probably not enough to say “just take the average rating and accept that.”

We need to think about, and teach about, the criteria we use and need to use when rating the raters.