9:30 AM
Coffee and bagels

10:00 AM - 11:30 AM
Recent advances in foundation models:
Continual training, time-series models and revisiting evals for vision-language models
Irina Rish
Université de Montréal and Mila-Quebec AI Institute

11:30 AM
Break

12:00 PM - 1:30 PM
Recent progress on state space language modeling
Alexander Rush
Cornell University and Hugging Face

1:30 PM
Lunch

2:30 PM - 4:00 PM
What is high-quality data in training LLMs?
Danqi Chen Princeton University

--

Organizers: Kamesh Krishnamurthy and Francesca Mignacco