Stephen Downes

Knowledge, Learning, Community

We see an awful lot in our field about what "the research tells us", typically stated in such a way as to suggest we are charlatans if we don't go along with it. I see this a lot, on a daily basis. "The research" is the basis of enterprises like the Campbell Collaboration, the promotion of various educational theories, and the authoring of well-meaning blog posts. But there is substantial reason to be sceptical. "All the old methods are in doubt. Even meta-analyses, which once were thought to yield a gold standard for evaluating bodies of research now seem somewhat worthless.... If you analyze 200 lousy studies, you'll get a lousy answer in the end. It's garbage in, garbage out." The crisis can't be wished away, nor can the basic lack of reproducibility be whitewashed. It's easy to hack your way to the conclusion you want to support. The phenomenon is well-documented, and we in education and technology should reserve judgements established through increasingly questionable methodology.

Today: 1058 Total: 1067 [Direct link] [Share]

Image from the website
View full size


Stephen Downes Stephen Downes, Casselman, Canada
stephen@downes.ca

Copyright 2024
Last Updated: Mar 29, 2024 10:49 a.m.

Canadian Flag Creative Commons License.

Force:yes