Neobert

Proud to see Lola Le Breton present NeoBERT: A Next Generation BERT at ICLR 2026 as part of the TMLR journal track. NeoBERT brings modern architecture, data, and pre-training to encoders, achieving state-of-the-art results on MTEB with just 250M parameters. With John X. Morris, Mariam El Mezouar, and Sarath Chandar.