Pre-registration
US free-community-college state experiments (Tennessee Promise 2015, Oregon 2016) raised enrolment and completion rates among low-income students without measurable fiscal crowd-out.
Falsification criterion — what would disprove this
This hypothesis is considered falsified if:
The hypothesis is considered falsified if the pre-registered empirical test shows the opposite direction of the claim at conventional significance (p > 0.10), or if the primary outcome measure moves less than 10% in the claimed direction across the sample. Exact thresholds will be pinned in the variables and estimator blocks when this stub is promoted from draft.
formal test & threshold
test: Callaway-Sant'Anna staggered DiD on community-college enrolment rate and associate-degree completion across US states 2010-2023, treating TN 2015 and OR 2016 cohorts; state-clustered SEs, state+year FE, COVID 2020-2021 dropped. Refute if average treatment effect on the treated (ATT) not >5% above non-Promise control trajectory at p<0.10 OR if state higher-ed appropriations show offsetting decline.
Method
- Template
did_callaway_santanna- Fixed effects
state, year- Clustering
state- Sample
- 1 countries · 2010 – 2023
- Evidence type
- associational
Staggered DiD across Tennessee Promise (2015) and Oregon Promise (2016) using non-Promise states as control. Callaway-Sant'Anna handles two-cohort structure. IPEDS enrolment/completion outcomes; pre-trend window 2010-2014.
Data
| Variable | Source | Transform |
|---|---|---|
community_college_enrolment_rate outcome | us_census:acs_school_enrollmenttier 1 bls:education_attainmenttier 1 | enrolment_per_18_24_population |
associate_degree_completion_rate outcome | us_census:acs_education_attainmenttier 1 | completion_per_cohort |
low_income_enrolment_rate outcome | us_census:acs_school_enrollmenttier 1 | enrolment_pct_low_income_18_24 |
state_higher_ed_appropriations_per_fte outcome | fred:state_govt_higher_ed_expenditure_per_capitatier 1 | real_usd_2020 |
tennessee_promise_2015 treatment | constructed:indicator = 1 for TN from 2015-08-01 (first cohort) onward; 0 prior or for non-Promise statestier 5 | binary |
oregon_promise_2016 treatment | constructed:indicator = 1 for OR from 2016-08-01 onward; 0 priortier 5 | binary |
any_promise_program treatment | constructed:state-cohort indicator combining TN 2015 and OR 2016 cohorts for staggered-DiD poolingtier 5 | binary |
state_unemployment_rate control | fred:state_unemployment_rate (LAUS)tier 1 | level_pct |
state_real_gdp_per_capita control | fred:state_gdp_per_capitatier 1 us_census:saipetier 1 | real_usd_log |
state_population_18_24 control | us_census:annual_state_population_estimatestier 1 | log_level |
pell_grant_eligibility_share control | fred:pell_grant_recipientstier 1 | share_of_undergrad |
● ready · ● pending · ● reconstruct-needed
Detailed result card
Result card — free_community_college_enrolment_completion
Verdict: INCONCLUSIVE_DATA_PENDING — no treatment variable loaded
Pre-registration
- Claim: US free-community-college state experiments (Tennessee Promise 2015, Oregon 2016) raised enrolment and completion rates among low-income students without measurable fiscal crowd-out.
- Falsification rule: The hypothesis is considered falsified if the pre-registered empirical test shows the opposite direction of the claim at conventional significance (p > 0.10), or if the primary outcome measure moves less than 10% in the claimed direction across the sample. Exact thresholds will be pinned in the variables and estimator blocks when this stub is promoted from draft.
Estimate (Callaway-Sant'Anna staggered DiD, TWFE approximation)
- Error: no treatment variable loaded
Variables resolved
us_census:acs_school_enrollment; bls:education_attainment→ community_college_enrolment_rate (outcome, n=1)us_census:acs_education_attainment→ associate_degree_completion_rate (outcome, n=1)us_census:acs_school_enrollment (filtered to bottom-quintile family income)→ low_income_enrolment_rate (outcome, n=1)fred:state_gdp_per_capita; us_census:saipe→ state_real_gdp_per_capita (controls, n=5)
Missing data
fred:state_govt_higher_ed_expenditure_per_capita(outcome)constructed: indicator = 1 for TN from 2015-08-01 (first cohort) onward; 0 prior or for non-Promise states(treatment)constructed: indicator = 1 for OR from 2016-08-01 onward; 0 prior(treatment)constructed: state-cohort indicator combining TN 2015 and OR 2016 cohorts for staggered-DiD pooling(treatment)fred:state_unemployment_rate (LAUS)(controls)us_census:annual_state_population_estimates(controls)fred:pell_grant_recipients (state aggregates)(controls)
Generated by scripts/run_did_callaway_santanna.py at 2026-05-04T13:02:34+00:00
Notes
Maps the democratic-socialist school's TN-Promise/OR-Promise enrolment-without-crowdout claim to a staggered Callaway-Sant'Anna DiD using non-Promise states as control. Estimator and prior set; full pre-registration awaits steelman + human sign-off.