Simon Ostermann

Acting director of the Multilinguality and Language Technology (MLT) lab @DFKI. Interim chair holder for translation-oriented language technologies at Saarland University. Research group lead of Efficient and Explainable NLP (E&E) @MLT.

Welcome ๐Ÿ‘‹

My research focuses on making language technology more accessible and fair, primarily for languages other than English. Two things run through most of my work: understanding what is actually happening inside language models, and making sure that understanding translates into models that work well for low-resource languages.

Concretely, Iโ€™m interested in mechanistic interpretability, the internal mechanisms behind specific model behaviors, in why particular training or adaptation choices change what a model knows or how it explains itself, and in turning such findings into explanations that are genuinely useful to people and that let researchers actually adjust models based on them, not just describe what is going on. Increasingly, this includes activation steering, a lighter-weight alternative to fine-tuning that turns such understanding directly into a way of changing model behavior.

That same interest in model internals carries over into my work on multilingual NLP. I care about making models more data-efficient and easier to control for low-resource languages, and increasingly about using interpretability-driven methods to align model behavior across languages instead of retraining separately for each one.

Beyond that, I contribute to SOOFI, a project building open, sovereign foundation models for German and English, mostly on the post-training side. I also have side projects on model factuality and multimodal models, and my earlier work was on commonsense reasoning and script knowledge for machine comprehension.

News ๐Ÿ“ฐ

October 2026AcceptEMNLP 2026: 6 papers accepted (3 Main, 3 Findings) spanning low-resource data steering, tokenization & quantization effects on interpretability, multilingual corpus auditing, and mechanistic translation analysis ๐ŸŽ‰๐Ÿ“š
September 2026AcceptBlackboxNLP 2026: 3 papers accepted (2 Main, 1 Reproducibility Track) on script representation, multilingual attribute steering, and the limits of automated simulatability ๐Ÿ”๐Ÿงฉ
September 2026TalkInvited talk at NEC Laboratories Europe (virtual)
September 2026TalkInvited talk at the Natural Language Understanding Group, University of Technology Nuremberg (Prof. Michael Roth)
July 2026TalkInvited talk at TUM Campus Heilbronn
April 2026AcceptACL 2026: 4 papers accepted (2 Main, 2 Findings) on activation steering, mechanistic RL analysis, multilingual steering benchmarks, and multimodal fact verification ๐ŸŽ‰๐Ÿง 
March 2026TalkKeynote at the General Assembly of idw (Informationsdienst Wissenschaften)
December 2025TalkKeynote at the 4th International Conference on Speech and Language Technologies for Low-Resource Languages (SPELLL)