Yesterday I recorded a podcast with Matthew Lee Loftus (from The Credible Hulk) and Christopher El Sergio for A Dash of Science, all about science communication and social media. It was a brilliant chat – I won’t go into lots of details of what we covered, but if you’d like to hear it (you know you do!) the direct link is: Communicating Science on Social Media. You can also pick it up on iTunes and/or Tune In.
After our conversation ended I remembered something I developed little while ago, after marking a particularly infuriating research homework where a quarter of the class wrote down that Mendeleev was awarded a Nobel prize for his work on the Periodic Table. For the record: he never received the honour. He was recommended for the prize but famously (at least, I thought it was famously!) the 1906 prize was given to Henri Moissan instead, probably due to a grudge held by Svante Arrhenius of Arrhenius Equation fame (it’s a good story, check it out).

Mendeleev was never awarded a Nobel prize.
Does it really matter if a few students believe that Mendeleev won a Nobel prize? That’s not really harming anyone, is it? Maybe not, but on the other hand, perhaps it’s part of a long and slippery slope greased with ‘alternative facts’ which is leading us to, well, shall we say, situations and decisions that may not be in our best interests as a society.
How to encourage students to do at least a little bit of fact-checking? Of course, you could produce a long list of Things That One Should Do to check information, but I reasoned that while students might read such a list, and even agree with the principles, they were unlikely to get into the habit of applying them and probably quite likely to immediately forget all about it.
Instead I tried to come up with something short, simple and memorable, and here it is (feel free to share this):

Fact-checking isn’t easy; it’s VARD
The four points I focused on spell out VARD, which stands for…
Verify
V is for verify, which means: can you find other sources saying the same thing? Now, chances are, you can always find something that agrees with a particular piece of information, if you look hard enough. There are plenty of sites out there that will tell you that lemons ‘alkalise’ the body, for example (they don’t), that it’s safe to eat apricot kernels (it’s not) and that black salve is an effective treatment for skin cancer (nope).
However, if you’re reasonably open-minded when you start, chances are good that you’ll find both sides of the ‘story’ and that will, at the very least, get you thinking about which version is more trustworthy.
Author
A is for author. I often hear swathes of content being disparaged purely based on its nature. You know the sort of thing: “that’s just a blog,” or “you can’t trust newspaper articles”. I think this is wrong-headed. What matters more is who wrote that piece and what are their qualifications? I’d argue that a blog post about medical issues written by a medical doctor (for example, virtually anything on the marvellous Science Based Medicine) is likely to be a pretty reliable source. Conversely, there’s been more than one thing that’s made it into the scientific literature which has later turned out to be flawed or even flat false (such as Wakefield’s famous 1998 paper). It’s also worth asking what someone’s background is: Stephanie Seneff, for example, is highly qualified in the fields of artificial intelligence and computer science, but does that mean we should trust her controversial opinions in biology and medicine? Probably not.
You may not always be able to tell who the author is, or have time to dig into their motivations, but it’s nevertheless a good question to keep in the back of your mind.
Reasonableness

Be honest: is that story really likely? Or is it just shocking?
R is for reasonableness. Which is a pain to spell or even say, but it’s important so I’m sticking with it. It’s a sense-check. Human beings love a good story, and the best stories have unexpected twists and turns. That’s why medical scare-stories pop up in newspapers with such depressing regularity. No, ketchup isn’t giving you cancer. No, our children really aren’t being poisoned by plastics. But the truth doesn’t always make a good headline. In fact, when it comes to science, the more some ‘exciting finding’ is plastered over news sites, the less you should probably trust it – because the chances are that the exciting version being reported bears almost no resemblance to the researchers’ original conculsions.
Be honest and ask yourself: does this really seem likely? Or would I just like it to be true because it’s a great story?
Date

If a surprising story has just appeared, give it twenty-four hours – chances are if there are major issues with the information someone else will come forward.
D is for date. The obvious situation is when information is so old that it’s been superseded by something else. This is easy: just look for something more recent. However, the other side of this coin is probably more relevant in these days of rolling news and instant sharing of articles: something can blow up at short notice, especially something topical, and it later turns out that not all the facts were known. Take, for example, the famous green swimming pools in the 2016 Olympics, which more than one writer attributed to copper salts in the pool water before the full facts were revealed a few days later. Inevitably, the ‘corrected’ version is far less interesting than the earlier speculation, and so that’s what everyone remembers.
If something controversial and shocking has just appeared, give it twenty-four hours. If there’s something terribly wrong with it, chances are someone will pick up on it in that time.
It’s not easy; it’s VARD
And that’s it: Verify, Author, Reasonableness, Date. It doesn’t cover every eventuality, but if you keep these points in the back of your mind it will definitely help you to separate the ‘probably true’ from the ‘almost certainly bollocks’.
Good luck out there!
Now why not go and listen to that podcast 🙂
Like the Chronicle Flask’s Facebook page for regular updates, or follow @chronicleflask on Twitter. All content is © Kat Day 2018. You may share or link to anything here, but you must reference this site if you do.
All comments are moderated. Abusive comments will be deleted, as will any comments referring to posts on this site which have had comments disabled.
All excellent good sense, as usual! The podcast is also worthwhile, addressing the far trickier problem of dealing with ‘true believers’.
I still wonder how this process takes place, from merely accepting some nonsensical information as true, but still capable of correcting these errors of judgement by acknowledging contradicting information, to really entrenching oneself and adopting a severely dogmatic stance on things. In other words: at what point and why do people sacrifice judgement based on facts and evidence, and turn to a religious mindset? (As I see it, the strong parallels between fundamentalist religious groups and for instance vocal antivaccine groups are unmistakeable.)
As also mentioned in the podcast, it is usually pointless to enter into discussions with these people, but then again, it is often fruitful to exchange ideas with the ones who haven’t completely gone down the rabbit hole yet.
E.g. some people I spoke to actually changed their minds after the found out how much profits ‘Big Pharma’ really makes with vaccines (some $10bn worldwide – far less than they make with even vitamin pills and other supplements), and that the idea is ludicrous that they pay off literally hundreds of thousands of scientists, health workers and other people involved in vaccination in order to hush up about ‘vaccine injuries’, just to protect these rather modest profits. Not to mention the fact that simply delivering good quality products is a far more sensible and sustainable business model than delivering crappy stuff and bribing countless people to keep mum about it.
But it would seem that there is a certain point of no return, after which the above information simply doesn’t make it into the brain of the antivaccine activist any more. Perhaps a case of Morton’s Demon?
LikeLike
Thanks! I hadn’t heard of Morton’s Demon – that’s a really cool idea/metaphor.
LikeLike
Pingback: The Chronicles of the Chronicle Flask: 2018 | the chronicle flask