HOrIc&RRO7HrEs#uNl NB%6GDjxO2Y0
My name is Justin Deschenaux and I am a PhD student at . I am advised by Professor Caglar Gulcehre, and I work on diffusion language models, a blazingly fast, controllable, and principled way to generate text. My research focuses on (1) fast inference through distillation and efficient architectures (SDTT, PGM, BlockGen); (2) bridging continuous and discrete diffusion to transfer powerful techniques (Diffusion Duality Chapter I, Chapter II); and (3) samplers that improve generation quality (Ψ-Samplers, Loopholing, BlockGen).

Latest News
- Apr. 2026
BlockGen was accepted to the ReALM-GEN workshop at ICLR 2026 and awarded a spotlight talk!
- Jan. 2026
Three papers were accepted to ICLR 2026: Partition Generative Modeling (PGM), Loopholing Discrete Diffusion, and The Diffusion Duality, Chapter II: Ψ-Samplers and Efficient Curriculum. PGM was awarded an oral presentation (top 1.13% of submissions)!
- Nov. 2025
We started a reading group on discrete diffusion with Subham and Zhihan.
- May. 2025
The Diffusion Duality was accepted at ICML 2025.
- Jan. 2025
Self-Distillation Through Time was accepted at ICLR 2025.
Selected Work
Language Modeling with Hyperspherical Flows
𝕊-FLM is a hyperspherical flow language model that replaces Gaussian noise on one-hot vectors with rotations on the unit sphere.
Partition Generative Modeling: Masked Modeling Without Masks
PGMs partition tokens to parallelize decoding with massive latency gains.