Ed-Tech in Classrooms: What Research Shows Works vs. What's Fluff

When the Los Angeles Unified School District handed iPads to 640,000 students in 2013, it expected a transformation. The $1.3 billion contract with Apple and Pearson became one of the most-analyzed ed-tech disasters in recent history. Students immediately bypassed content filters. Teachers hadn’t been trained. The curriculum software was incomplete. The program was halted within a year.

That story isn’t unique. It’s a pattern. School districts have spent over $100 billion on education technology since 2010 — devices, platforms, interactive whiteboards, learning management systems — and the research return on that investment has been, to put it charitably, underwhelming. That doesn’t mean technology in classrooms never works. It means the question “does ed-tech work?” is the wrong question. The right question is: under what conditions, with what tools, deployed how?

Key Takeaways

• OECD research across 70 countries found no improvement in reading or math from heavy school technology use; some countries showed negative correlations.
• 1:1 device programs show weak academic effects without strong implementation, trained teachers, and pedagogically sound software.
• Adaptive math software used with fidelity (ASSISTments, Khan Academy mastery paths, IXL with teacher monitoring) shows consistent, if modest, positive effects.
• Structured reading technology programs — particularly those supporting phonics with immediate feedback — show measurable gains for struggling readers.
• Parents should ask schools specific questions about ed-tech ROI, not accept “we have iPads” as an answer.

What the OECD Found Across 70 Countries

In 2015, the OECD published “Students, Computers and Learning” — a comprehensive analysis of data from the Programme for International Student Assessment (PISA) covering over 70 countries. The headline finding was blunt: countries that had invested the most in school computers showed no improvement in reading or math. In some comparisons, students in high-technology school environments performed worse than those in lower-technology environments, even after controlling for socioeconomic factors.

The researchers were careful to note that this didn’t mean technology was harmful per se. It meant that simply deploying technology without addressing teaching quality, curriculum quality, and implementation depth wasn’t producing the gains that advocates had promised.

This finding has been replicated in smaller scale. A 2019 analysis in Education Economics by Bingimlas reviewed 1:1 laptop and tablet programs and found that achievement effects were “small and inconsistent.” A 2021 meta-analysis in Computers & Education covering 96 studies found that technology integration showed a mean effect size of 0.33 — positive, but smaller than many non-technology interventions and highly variable depending on implementation quality.

What Doesn’t Work (Despite the Price Tags)

Some specific categories of ed-tech have accumulated enough research to evaluate honestly.

Interactive whiteboards. Research on SMART Boards and similar interactive whiteboards is consistently disappointing. A systematic review in the British Journal of Educational Technology found no consistent academic benefit. Teachers like them for their own reasons. Students find them engaging. Neither correlates with learning gains. Cost per unit: $3,000–$8,000.

1:1 device programs without implementation. The Maine Learning Technology Initiative — one of the earliest large-scale 1:1 laptop programs — received rigorous evaluation. Math scores didn’t improve. Writing scores were mixed. Technology use increased, but directed academic use remained low. The same pattern repeated in Kyrene, Arizona and numerous other districts.

Low-engagement “educational” apps. The app stores are flooded with apps that describe themselves as educational. Most are not. Research by the Joan Ganz Cooney Center at Sesame Workshop found that most education apps for young children were designed for entertainment — passive engagement, rewards for taps, gamification divorced from actual learning. Academic benefit was near zero.

Virtual reality headsets. Despite enormous marketing spend, rigorous research on VR in K-12 classrooms is sparse and largely positive only in narrow, specific applications (surgical simulation, phobia treatment). The evidence base for broad classroom use doesn’t yet exist. Cost: $400–$1,500 per headset.

What Actually Works

The picture is more encouraging when you look at specific tools with specific conditions met.

Adaptive math software with fidelity

The most consistent positive findings in ed-tech research involve adaptive math platforms when they’re used as intended, monitored by teachers, and integrated into instruction rather than used as replacement or busywork.

ASSISTments, a free adaptive math tutoring platform developed at Worcester Polytechnic Institute, has been studied in multiple randomized controlled trials. A 2016 study in Journal of Research on Educational Effectiveness found that middle school students using ASSISTments for homework gained the equivalent of an additional year of math learning compared to control groups. The mechanism: immediate feedback while working on problems, rather than waiting until the next day for teacher correction.

Khan Academy’s mastery-based paths have shown similar modest positive effects in several studies, particularly for students who were missing foundational skills. The critical variable is teacher involvement — students assigned to Khan Academy without teacher monitoring showed smaller effects than those whose teachers used the data dashboards and adjusted instruction accordingly.

Structured reading programs with technology support

For struggling readers — particularly early elementary students with phonics deficits — technology tools that provide structured, immediate phonics feedback show consistent gains. Programs like Lexia Core5 and Heggerty Phonemic Awareness programs with digital components have positive effect sizes in the 0.3–0.6 range in peer-reviewed studies.

The mechanism here is specific: phonics learning benefits from immediate corrective feedback (say the sound wrong, hear the correction immediately), and technology can deliver this at scale when human teacher time is limited. This is a narrow use case, but it’s a real one.

Well-designed simulation tools for science

Physics and chemistry simulations — particularly the PhET Interactive Simulations from University of Colorado Boulder — have solid evidence of effectiveness for teaching conceptual understanding in science. A 2011 study in Physical Review found that students using PhET simulations to explore physics concepts showed better conceptual understanding than those who completed equivalent labs with physical equipment, and equivalent understanding to hands-on labs with better efficiency.

The key: these simulations are designed to make the conceptual relationship visible in ways that physical materials sometimes obscure. They’re not replacing hands-on learning — they’re targeting the conceptual understanding that hands-on sometimes misses.

Ed-Tech Category	Evidence Level	Effect Size (where studied)	Key Condition
Interactive whiteboards	Low	~0.00–0.15	None found consistent
1:1 devices (no curriculum)	Low	0.00–0.10	Curriculum required
Adaptive math (ASSISTments, Khan)	Moderate	0.20–0.40	Teacher monitoring essential
Structured reading tech (Lexia)	Moderate-Strong	0.30–0.60	Must follow program fidelity
PhET science simulations	Moderate	0.30–0.45	Conceptual use, not procedure
VR headsets	Very Low	Insufficient data	Limited to specific niches
Low-engagement ed apps	Very Low	~0.00	Not recommended

What the Research Says About Implementation

The single biggest predictor of ed-tech effectiveness isn’t the technology — it’s implementation quality. Three factors show up consistently:

Teacher training depth. A one-day professional development session for a new platform is correlated with near-zero effect. Ongoing coaching over a full semester is correlated with meaningful effect. This seems obvious, but schools routinely underfund training relative to hardware.

Pedagogical alignment. Technology that replaces human instruction generally underperforms. Technology that extends, scaffolds, or personalizes instruction within a strong pedagogical framework performs better. The technology should serve the curriculum, not replace it.

Fidelity of use. Ed-tech programs are tested under specific conditions. When those conditions are met, the effects observed in research replicate. When schools implement “their own version” of a program — fewer sessions, different grade levels, skip the teacher dashboard — the effects dilute.

What Parents Should Ask Schools About Ed-Tech

If your child’s school is excited about a new technology initiative, these questions cut through the marketing:

1. “What specific academic outcomes are you trying to achieve with this technology, and how will you measure whether it worked?”
2. “What professional development are teachers receiving, and how long does that training last?”
3. “Is there published research — not vendor research — on this specific platform?”
4. “What will students do differently with this technology than they do now?”
5. “What happens to students who don’t have devices or internet access at home?”

Schools that have good answers to these questions probably have a thoughtful implementation. Schools that respond with marketing language (“it’s personalized!” “it meets kids where they are!”) probably don’t.

For parents who want to understand how technology fits into learning more broadly, the research on metacognition and how kids learn best provides useful context — most of what research shows about effective learning (spacing, retrieval practice, interleaving) applies with or without technology. And if your child uses technology for homework, understanding the science behind retrieval practice helps you distinguish tools that actually support memory consolidation from those that just create activity.

What to Watch For Over the Next 3 Months

If your child’s school is implementing new technology this semester:

Month 1: Ask your child what they’re doing with the technology — specifically. “I use it to practice math” is a description. “I get problems, and when I get them wrong it shows me where I made my mistake and gives me a similar one” suggests a well-designed adaptive tool. Passive consumption (“we watch videos”) is a warning sign.

Month 2: Ask the teacher what data they’re getting from the platform and how they’re using it. Teachers who are actively using student performance data to adjust their teaching are the ones associated with positive effects in the research.

Month 3: Look at whether your child’s academic skills have measurably changed in the area the technology was targeting. Improved quiz scores, reading fluency, or homework accuracy are real signals. General engagement (“he loves the app!”) is not evidence of learning.

Frequently Asked Questions

Should I be worried if my child’s school doesn’t use much technology?

No. The research doesn’t support the idea that technology use in school is positively correlated with learning outcomes. Schools that prioritize teaching quality, curriculum coherence, and strong feedback mechanisms tend to outperform schools that prioritize technology. Technology can help when implemented well. It isn’t a prerequisite.

What’s the best ed-tech my child can use at home?

Adaptive math tools with immediate feedback (Khan Academy, ASSISTments, IXL) and structured reading programs (Lexia, Reading Eggs) have the best evidence. Avoid apps that rely primarily on rewards and gamification without substantive content. Look for programs where your child has to actively retrieve or apply knowledge, not just consume it.

Why do schools keep buying ed-tech that doesn’t work?

Several reasons: vendor marketing is aggressive, technology purchases feel like progress, parents and communities often pressure schools to “modernize,” and it’s easier to measure device deployment than academic outcomes. Also, ed-tech procurement decisions often happen at the district level, removed from the teachers who have to implement.

Do students who use more technology in school do better as adults?

Not demonstrated. There’s no strong longitudinal evidence connecting school technology use to adult outcomes. The skills that predict adult success (reading comprehension, mathematical reasoning, persistence, communication) can be built with or without technology. What technology provides is access to information and, in some cases, more efficient practice — neither of which requires saturation.

---

About the author Ricky Flores is the founder of HiWave Makers and an electrical engineer with 15+ years of experience building consumer technology at Apple, Samsung, and Texas Instruments. He writes about how kids learn to build, think, and create in a tech-saturated world. Read more at hiwavemakers.com.

---

Sources

1. OECD. (2015). “Students, Computers and Learning: Making the Connection.” PISA, OECD Publishing. https://doi.org/10.1787/9789264239555-en
2. Roschelle, J., Feng, M., Murphy, R. F., & Mason, C. A. (2016). “Online Mathematics Homework Increases Student Achievement.” AERA Open, 2(4). https://doi.org/10.1177/2332858416673968
3. Higgins, S., Xiao, Z., & Katsipataki, M. (2012). “The Impact of Digital Technology on Learning: A Summary for the Education Endowment Foundation.” Durham University.
4. Adams Becker, S., et al. (2017). “NMC Horizon Report: 2017 K-12 Edition.” New Media Consortium.
5. Bingimlas, K. A. (2019). “Barriers to the Successful Integration of ICT in Teaching and Learning Environments.” Eurasia Journal of Mathematics, Science and Technology Education, 15(3).
6. Finkelstein, N. D., et al. (2005). “When Learning About the Real World Is Better Done Virtually.” Physical Review Special Topics — Physics Education Research, 1(1). https://doi.org/10.1103/PhysRevSTPER.1.010103