The Dutch 3E Framework
Educational Technology (EdTech) plays an increasingly central role in education, transforming how students learn, teachers instruct, and institutions manage resources. EdTech refers to digital tools designed to advance education by enhancing teaching, learning experiences and streamlining administrative tasks. Npuls Pilothub EdTech is committed to developing a clear vision that enhances collaboration and learning between educational institutions and EdTech companies. This vision addresses the growing need for effective partnerships that leverage technology to meet educational challenges. The 3E framework offers practical guidance on assessing EdTech effectiveness and provides valuable insights to support informed decision-making on technology adoption in education.
The 3E Framework
While EdTech has the potential to enhance learning, its effectiveness depends on the right fit with the educational context. Because institutions do not demand evidence, EdTech providers do not feel the need to rigorously evaluate their products, creating a cycle where tools are used without clear evidence of impact. This highlights the need for an evidence-informed evaluation of EdTech tools to assess their effectiveness and determine the contexts in which they work best. While evaluation alone can offer insights into usability and implementation, evidence ensures that evaluations are based on measurable impact rather than subjective perceptions or engagement metrics.
“If the demand for evidence increases through national standards, more EdTech companies will invest in evaluation.”
– Michael Forshaw, CEO, EdTech Impact
The Dutch 3E Framework offers an evidence-informed approach to evaluate the effectiveness of EdTech. A key feature of the framework is its emphasis on continuous evaluation rather than static, one-time validation, ensuring EdTech tools are improved over time. The primary aim of the Dutch 3E Framework is not to mandate evaluation for all tools but to promote a culture where evidence-informed decision-making is embedded in all EdTech-related processes. This framework serves as a practical guide on how evidence is generated, interpreted, and used to develop, procure, and improve EdTech effectively. Also, the Dutch 3E Framework lays a solid foundation for deeper collaboration between academia, institutions, and the EdTech sector. When all stakeholders work together to generate, interpret, and apply evidence, EdTech adoption moves from trial-and-error to a strategic and sustainable process. Ultimately, this paves the way for more effective and future-ready educational technology integration.
Levels of evidence
Bronze level
The Bronze Level represents the basic standard of evidence, relying on non-empirical research without measurable data. Findings are derived from theoretical models rather than real-world validation and reflect whether the tool is based on solid educational theories and well-replicated research studies, Research methods include logic model creation, building a theory of change, desk-based research and expert consultations to hypothesise the effectiveness of an EdTech tool.
Silver level
The Silver Level involves experimental studies without a control or comparison group, meaning causality cannot be definitively established. Research methods include correlational studies, user experience research, contribution analysis, and small case studies. While findings can suggest a positive association between EdTech use and relevant outcomes, they lack the rigour required to confirm causation.
Gold level
The Gold Level represents the highest standard of evidence. It requires experimental studies with a control or comparison group to establish strong causal relationships. Research methods include Randomized Controlled Trials (RCTs), quasi-experimental studies, and case-controlled studies. This level ensures that findings are statistically significant and evaluates effectiveness across different subgroups, explaining any disparities.
Steps to use the framework
1. Collect Evidence
Evidence is generated through public-private partnerships, where institutions and EdTech providers collaborate in co-creation to conduct research and produce reliable evidence on EdTech effectiveness.
2. Apply Evidence
Once generated, evidence is applied to decision-making. Institutions use the evidence to select tools that align with their specific educational needs. EdTech providers use the evidence to identify areas for improvement and refine their tools accordingly to enhance their impact.
3. Update Evidence
Evidence collection is a continuous process that evolves with changing needs. Institutions update evidence based on real-world performance and their evolving educational priorities. EdTech providers update evidence whenever they make improvements or introduce new functionalities, ensuring that tools remain relevant and effective.