IESET.
Hypotheses·welfare architecture·welfare_reform_germany_hartz_iv_unemployment_consolidation

The Hartz IV reform (Jan 2005, consolidating Arbeitslosenhilfe and Sozialhilfe into a single means-tested benefit with stricter activation rules) cut Germany's long-term-unemployment rate by at least 30% within seven years (2005-2012) relative to a synthetic-control of EU peers (FRA, BEL, NLD, AUT, ITA), with the activation channel decomposed from the wage-floor channel by tracking the simultaneous Hartz I-III placement-service reforms.

PARTIALengine/runs/welfare_reform_germany_hartz_iv_unemployment_consolidation

PARTIAL — mean_gap=+3.666, |gap|/pre_sd=6.1, p_perm=0.833; claim direction ambiguous

confidence cueThe result is useful, but not decisive. Treat it as a clue, not a settled conclusion.

policy briefMixed or noisy

In ordinary language

In plain terms, this asks whether hartz iv indicator is actually linked to better or worse long term unemployment rate from 1995 to 2015.

plain answer

The evidence is suggestive but not decisive. mean_gap=+3.666, |gap|/pre_sd=6.1, p_perm=0.833; claim direction ambiguous

why it matters

This matters because welfare architecture claims should change belief only when they survive a pre-declared empirical test.

how the test works

It compares 6 country or place units from 1995 to 2015, using a synthetic control design, with fixed effects for country and year.

what was measured
What changed
  • Hartz iv indicator
What we checked
  • Long term unemployment rate
  • Employment rate age 55 64
what this does not prove

A single test is not the whole truth. It narrows the claim under a specific sample, time period, and method. Strong policy conclusions need the pattern to survive nearby tests, alternative data, and serious objections.

verification

No evidence packet has been generated yet.

Results

engine/runs/welfare_reform_germany_hartz_iv_unemployment_consolidation
1007550250199520052015DEUFRABELNLDAUTITA
illustrative sketch · run pending
No coefficients yet. When the model fires, this chart will show long_term_unemployment_rate across 6 sampled countries over 1995–2015.
The shapes above are stylised — none of the lines are real data.
Placeholder for welfare_reform_germany_hartz_iv_unemployment_consolidation. Published chart will be generated from engine/runs/welfare_reform_germany_hartz_iv_unemployment_consolidation/chart_data.json.

Pre-registration

registration ordering unverified
first-spec commit 4c8ce8e · 2026-07-18T22:11:21Z
run generated · 2026-05-04T20:44:02Z
Run timestamp predates this path's first git-add commit (rebase, rename, or pre-git local run). Spec hash is still the path's first-add commit — not repository HEAD — but ordering is not a clean pre-registration proof.

The Hartz IV reform (Jan 2005, consolidating Arbeitslosenhilfe and Sozialhilfe into a single means-tested benefit with stricter activation rules) cut Germany's long-term-unemployment rate by at least 30% within seven years (2005-2012) relative to a synthetic-control of EU peers (FRA, BEL, NLD, AUT, ITA), with the activation channel decomposed from the wage-floor channel by tracking the simultaneous Hartz I-III placement-service reforms.

Falsification criterion — what would disprove this

set before the run · honoured after

This hypothesis is considered falsified if:

Refuted if the synthetic-control gap on long-term-unemployment at seven-year horizon is below 30% reduction, OR if placebo permutation p-value exceeds 0.10, OR if the Hartz-I-III pre-window placebo also shows a negative gap of comparable magnitude (suggesting common-trend rather than treatment effect).

formal test & threshold
test:      synthetic_control_7yr_gap_long_term_unemployment
threshold: gap_relative <= -30% at 7yr horizon AND placebo_p < 0.10 AND placebo_pre_window_gap > -10%

Method

Template
synthetic_control
Fixed effects
country, year
Clustering
country
Sample
6 countries · 1995 – 2015
Evidence type
causal

Synthetic control on DEU long-term-unemployment series 1995-2015 with FRA, BEL, NLD, AUT, ITA donor pool. Pre-treatment fit 1995-2004 (excluding GFC). Hartz I-III timing 2003 tested as placebo ahead-of-Hartz-IV check.

Data

VariableSourceTransform
long_term_unemployment_rate
outcome
oecd:DSD_LFS_BStier 2
level_pct
employment_rate_age_55_64
outcome
oecd:DSD_LFS_BStier 2
level_pct
hartz_iv_indicator
treatment
oecd:DSD_LFS_BStier 2
indicator
gdp_per_capita_real
control
world_bank_wdi:NY.GDP.PCAP.KDtier 2
log
trade_openness
control
world_bank_wdi:NE.TRD.GNFS.ZStier 2
level
union_density
control
oecd:DSD_TUDtier 2
level

● ready  · ● pending  · ● reconstruct-needed

Detailed result card

Result card — welfare_reform_germany_hartz_iv_unemployment_consolidation

Verdict: PARTIAL — mean_gap=+3.666, |gap|/pre_sd=6.1, p_perm=0.833; claim direction ambiguous

Pre-registration

  • Claim: The Hartz IV reform (Jan 2005, consolidating Arbeitslosenhilfe and Sozialhilfe into a single means-tested benefit with stricter activation rules) cut Germany's long-term-unemployment rate by at least 30% within seven years (2005-2012) relative to a synthetic-control of EU peers (FRA, BEL, NLD, AUT, ITA), with the activation channel decomposed from the wage-floor channel by tracking the simultaneous Hartz I-III placement-service reforms.
  • Falsification rule: Refuted if the synthetic-control gap on long-term-unemployment at seven-year horizon is below 30% reduction, OR if placebo permutation p-value exceeds 0.10, OR if the Hartz-I-III pre-window placebo also shows a negative gap of comparable magnitude (suggesting common-trend rather than treatment effect).

Synthetic-control estimate

  • shape: synth_did
  • treated_country: DEU
  • event_year: 2005
  • n_donors: 5
  • donor_weights (top): {'AUT': 0.6324, 'BEL': 0.3197, 'FRA': 0.0479, 'NLD': 0.0, 'ITA': 0.0}
  • pre_rmse: 0.5205845128621379
  • pre_period_sd: 0.6026139726226062
  • mean_post_gap: 3.6658428933090814
  • end_period_gap: 6.18624340991731
  • post_period_years: [2005, 2015]
  • placebo_p_value: 0.8333333333333334
  • n_placebos: 5
  • method: synthetic-control via NNLS, permutation inference

Variables resolved

  • oecd:DSD_LFS_BS@DF_EMP_RATE → employment_rate_age_55_64 (outcome, n=2255)
  • oecd:DSD_LFS_BS@DF_LTUE → hartz_iv_indicator (treatment, n=126)
  • world_bank_wdi:NY.GDP.PCAP.KD → gdp_per_capita_real (controls, n=14066)
  • world_bank_wdi:NE.TRD.GNFS.ZS → trade_openness (controls, n=10714)

Generated by scripts/run_synth_did.py at 2026-05-04T20:44:02+00:00

Strongest opposing argument

Every hypothesis ships with its charitable opposing argument. The framework earns credibility by handling objections at their strongest, not weakest.

Authored framework. Read the transparency note.