arXiv:2604.25891, v1 submitted 28 April 2026. v1 is still the only version (abs page checked 2026-11-19) and is the one read, as arXiv HTML. Five authors: Dubiński (Warsaw University of Technology, NASK, Constellation), Betley and Evans (Truthful AI; Evans also UC Berkeley), Sztyber-Betley (Warsaw University of Technology) and Tan (UCL, Center on Long-Term Risk). Not to be confused with the same first author's later subliminal-learning paper (arXiv:2610.10657, stub source-2026-subliminal-beyond-owls-dubinski).
The paper tests three mitigations for emergent misalignment: diluting misaligned data with benign data, fine-tuning on benign HHH data afterwards, and inoculation prompting, including Betley et al.'s educational-insecure dataset. Each reduces misalignment on the standard EM questions, in most settings to near zero. The exceptions are the Hitler-inoculated models (6%, against 11% without inoculation) and some GPT-4.1 poisonous-recipe models. Each also leaves misalignment that returns when the evaluation prompt carries cues from the training data or the inoculation prompt. Experiments use supervised fine-tuning only: GPT-4o and GPT-4.1 through the OpenAI API, DeepSeek-V3.1 and Qwen3-32B through Tinker LoRA, scored by GPT-4o judges. A further set tests on-policy against off-policy SFT, and reasoning-trace distillation, under inoculation.
Citable numbers. Every value the finding cites is printed in the body text of §§2–4 and 6, in the text of Appendices E and F, or in a figure caption (Figure 7's 0.1%). Line numbers in the filer's hand-back refer to the cached .md. No figure image was saved, and no value is read off a figure. The following are therefore not cited: per-prompt rates for the inoculated insecure-code models (§3.2, Figure 11), per-prompt Hitler rates (Figures 12, 45, 48), the poisonous-recipe per-fraction curves (Figures 15–21), and all DeepSeek-V3.1 data-mixing and sequential-HHH values (Figures 33, 34, 39).
Internal inconsistencies. The text disagrees with itself in several places. Three are recorded in the finding:
- The GPT-4o 10,000-HHH checkpoint's untriggered rate is 0.1% in Figure 7's caption and 0% in §6.
- The triggered rate is called a tenfold rise, but it is 0.41% against 0.1%.
- Appendix F.4's metric is described as the fraction of wrong answers, apparently copied from the training-data judge.
The others:
- Figure 13's caption gives about 11.7% and 21.8%, and §4.1's text gives 11.6% and 21.6%.
- §2.1 says generic prompts give zero misalignment at every fraction, and Appendix B says GPT-4.1 at 10% already shows some.
- §4.2 says Qwen3-32B shows the same effect of reasoning traces, but weaker. Appendix F.9 says reasoning distillation does not reduce it.
- The abstract says on-policy training leaves conditional misalignment non-zero. Appendices F.5 and F.7 report it eliminated for GPT-4.1.
Local copies: cache/papers/source-2026-conditional-misalignment-dubinski.{html,md} (arXiv HTML v1), cache/papers/source-2026-conditional-misalignment-dubinski-abs.html (abs page). Code: https://github.com/jandubinski/conditional_misalignment (resolves; not cloned, not read).