How Magna works, and what our classroom studies show

ESSA Tier IV · Demonstrates a Rationale

Magna logic model and theory of change

Our logic model shows how Magna's three parts are expected to lead to stronger free-response writing and better AP exam results: free-response practice with instant rubric feedback, the Ask Magna AI tutor, and Skill Builder for problem-solving and critical-thinking sub-skills. Each design decision is tied to published research, and the model summarizes our plan for the next study.

What's inside

• The logic model and theory of change
• Six design decisions and the research behind each
• An annotated bibliography of 18 sources
• A summary of the planned same-year comparison study

ESSA Tier III · Promising Evidence

Magna Education and AP Exam Outcomes: Study Report

In AP U.S. Government and Politics, we compared the class that used Magna with the same teacher's class from the year before, adjusting for each student's score on a unit test taken before Magna use. A second classroom, in AP Biology, taught by a different teacher, provides a supporting replication.

Key findings

• AP U.S. Government: after adjusting for prior achievement, students in the Magna year had 2.25 times the odds of scoring 4 or 5 on the AP exam (95% CI 1.04 to 4.87, p = .039).
• Their mean AP score was 0.32 points higher (p = .032), and the share scoring 5 rose from 12.7% to 35.0%.
• AP Biology: the pass rate rose from 78.4% to 88.5%, about 9 points more than the national change; this was not statistically significant.

The findings are consistent with the requirements for ESSA Tier III (Promising Evidence).