Stephen Downes

Knowledge, Learning, Community

This paper (14 page PDF) argues convincingly that there is no consensus on the evaluation of educational technology and proposes "the Multiple EdTech Impact Index (MEII) and an impact benchmarking formula for EdTech tools" in response. MEII is based on "the 5Es framework, which corresponds to the 17 Sustainable Development Goals (SDGs) and categorizes impact into two dimensions relevant to educational outcomes (Efficacy and Effectiveness) and three dimensions relevant to broader impact outcomes (Ethics, Equity and Environment)." Additionally, these five indices are intended to be interdependent; by contrast, "current EdTech evaluation frameworks are not well-suited for capturing such interdependencies because they focus on specific quality indicators rather than overall impact." Thus, for example, you get "high effect sizes for specific tools, but their effect showed to benefit only 5 % of the target population." I think the authors' intent is laudable, but it is unlikely that an international consensus will be reached on things like equity, ethics and environment. See also the EdTech Impact Project.

Today: Total: [Direct link] [Share]


Stephen Downes Stephen Downes, Casselman, Canada
stephen@downes.ca

Copyright 2025
Last Updated: Oct 07, 2025 1:30 p.m.

Canadian Flag Creative Commons License.