The quality of instructional materials placed in the hands of teachers has become a focal point of American education policy. Following more than a quarter-century of standards-based reform, policymakers increasingly recognize that sweeping educational mandates—such as the Common Core State Standards or the widespread adoption of the "science of reading"—will fail to improve student achievement unless the underlying curriculum, textbooks, workbooks, instructional software, and assessments are genuinely effective.
Despite a growing consensus that schools should rely on evidence-based curricula, a systemic structural barrier persists: schools and districts lack access to reliable, independent data showing which educational materials actually improve student learning outcomes. While the demand for data-driven decisions has never been higher, the mechanisms required to evaluate these products are fraught with logistical, financial, and methodological hurdles. Without fundamental reforms in how states collect data and how research is conducted, the push to choose curricula based on proven learning gains will remain an elusive ideal.
The Evolution of Curriculum Reform
The modern focus on instructional materials began in earnest during the early implementation of the Common Core standards in the early 2010s. Independent researchers quickly scrutinized publishers’ marketing claims, revealing that many textbooks and digital platforms marketed as "aligned" to the new standards fell short of the mark. This skepticism catalyzed the creation of external evaluation organizations, most notably EdReports, which began systematically rating curriculum materials for content alignment and instructional usability. These independent ratings quickly became influential touchstones for state and district adoption committees.
More recently, the nationwide push to align reading instruction with cognitive science—sparked largely by Mississippi’s dramatic reading gains—has drawn state departments of education deeper into the curriculum evaluation business. States are increasingly vetting reading programs, publishing approved lists, and tying adoption to specialized professional development.
Simultaneously, a parallel movement has championed rigorous empirical evaluation of educational interventions. Spearheaded by federal benchmarks such as the What Works Clearinghouse (WWC) and codified into law through the Every Student Succeeds Act (ESSA) in December 2015, this movement established a tiered definition of "evidence-based" practices. ESSA’s four evidence tiers—ranging from Tier 1 (strong causal evidence from randomized controlled trials) to Tier 4 (demonstrating a rationale based on high-quality research)—were designed to help educators cut through marketing claims and ground purchasing decisions in proven student achievement data.
In theory, districts should be able to consult databases like the WWC or Johns Hopkins University’s Evidence for ESSA project to select top-tier, proven educational materials. In practice, however, these two powerful policy trends—state-level curriculum vetting and rigorous evidence standards—have failed to merge into a functional, data-driven marketplace.

The Edtech Controversy and Market Realities
The friction between evidence-based ideals and classroom realities recently erupted into public view through a series of viral critiques targeting widely used educational technology and assessment systems, such as Curriculum Associates’ iReady platform. Critics and independent analysts questioned the validity of research supporting these platforms, pointing out that many studies are funded internally by the companies themselves, utilize weaker research designs, and fail to meet the stringent criteria of ESSA’s top tiers.
Yet, educational experts and policy researchers argue that placing the blame solely on curriculum publishers and edtech providers misdiagnoses the problem. Driven by competitive pressures and the demands of lucrative state-adoption markets like California, Florida, and Texas, most curriculum companies are genuinely attempting to improve their products and demonstrate efficacy. However, they face a landscape devoid of the foundational infrastructure needed to conduct rigorous, independent research.
The Missing Foundation: State Data Deficits
The root cause of the current evaluation crisis is a failure of state-level data collection. Over the decade since ESSA’s enactment, very few state education agencies have systematically tracked which core curriculum materials are adopted by their local school districts, let alone monitored how those materials are implemented in classrooms.
Without state-level tracking, independent researchers cannot easily access the data required to study curriculum effectiveness at scale. Consequently, publishers seeking to sell products in states that mandate impact evidence are forced to shoulder the financial and operational burden of conducting their own studies. This dynamic creates an inherent conflict of interest, incentivizing minimal compliance rather than objective, expansive scientific inquiry.
A recent comprehensive review of 36 publicly available studies examining K–5 English language arts curricula revealed pervasive methodological flaws. The vast majority of these studies suffered from selection bias, failed to account for the clustering of students within classrooms, or relied on vague, unspecified "business-as-usual" comparison groups rather than benchmarking against competing commercial curricula. Only a fraction of the analyzed research met basic standards of reliability, leaving districts with virtually no trustworthy data on which specific curriculum yields the highest academic gains.
Why Current Evidence Standards Clash with Classroom Realities

The application of rigid medical-model research standards—such as those codified in ESSA Tier 1—to core educational curricula creates nearly insurmountable hurdles for several reasons:
Unrealistic Timelines: Curriculum adoption cycles operate on multi-year schedules, often aligning with state standards revisions. Requiring publishers to produce randomized controlled trial (RCT) evidence before approving a product creates a Catch-22: companies cannot conduct large-scale studies without first selling their materials to schools.
Logistical Impossibilities: Conducting a Tier 1 randomized controlled trial requires school districts to surrender local control and allow researchers to randomly assign different curricula to different schools. Districts are understandably reluctant to gamble with core instruction. Furthermore, if a publisher funds a study comparing its new curriculum to its older version, the financial and marketing risks of publishing a null or negative result are prohibitive.
Questions of Validity and Generalizability: Studies that successfully implement random assignment often do so under highly artificial conditions—such as intensive, direct professional development provided by the publisher—that do not reflect typical classroom environments. Consequently, the findings may lack external validity when scaled to diverse, under-resourced districts.
The Measurement Problem: Evaluating curriculum efficacy relies heavily on state standardized tests. However, state assessments often lag behind modern curriculum content, suffer from low instructional sensitivity, and struggle to accurately measure growth for students performing significantly below grade level.
The Implementation Gap: Instructional materials do not use themselves. Teacher implementation varies wildly, with some curricula remaining untouched on classroom shelves. Without granular data on daily classroom usage—gathered via teacher logs or digital metadata—evaluations can only measure average program effects, obscuring whether the curriculum or its execution drove the results.
Toward a Practical Model for Curriculum Evaluation
If policymakers are serious about grounding instructional material purchases in student learning data, the education sector must abandon impractical expectations and build a realistic, sustainable evaluation infrastructure. Experts suggest a four-pillar model to bridge the gap between policy ideals and operational reality:

-
Comprehensive State Data Collection: State education agencies must mandate annual reporting on core curriculum adoptions, supplementary materials, and interim assessments used across every school district. Establishing centralized registries of curriculum use is the essential first step for any subsequent research.
-
Investment in Research Infrastructure: States and private philanthropic foundations must allocate dedicated funding to support independent researchers. By partnering with universities and research organizations, states can leverage existing administrative data to conduct quasi-experimental studies that compare value-added student achievement across districts using different materials.
-
Pragmatic Implementation Tracking: To understand why certain materials succeed, systems must monitor classroom implementation. This can be achieved through lightweight, low-burden teacher surveys and the analysis of digital curriculum metadata, capturing the fidelity of instruction without overwhelming educators.
-
Embracing Diverse Methodologies: While large-scale causal studies remain valuable, policymakers should embrace a broader spectrum of research, including A/B testing within digital platforms to evaluate specific pedagogical features, alongside localized qualitative studies.
The movement to elevate curriculum quality represents one of the most promising developments in modern education reform. However, realizing its potential requires acknowledging that publishers cannot be expected to independently police their own products in a data vacuum. By establishing robust state-level data collection, funding independent evaluations, and aligning research standards with the practical realities of K–12 schools, policymakers can finally build an evidence-based marketplace that delivers superior instructional materials to every classroom.
