Talks.

Measuring Agents in Production

Invited talk at NICE Talk Series.

Measuring Agents in Production

Invited talk at Google Sense AI.

Building and Optimizing Compound AI Systems in Production

Keynote at the Workshop on Recommender Systems for Sustainable Development.

Evaluation of Information Retrieval Systems in the Generative Era

Invited talk at the Thomson Reuters Research Lab.

PhD Seminar 2 — Assessing and Verifying Task Utility in LLM-Powered Applications

Data Systems Group, University of Waterloo.

• Slides

Evaluation of Information Retrieval Systems in the Generative Era

Talk at Thomson Reuters Lab.

• Slides

PhD Seminar 1 — Fréchet Distance for Offline Evaluation of Information Retrieval Systems with Sparse Labels

Data Systems Group, University of Waterloo.

• Slides

Evaluation of Information Retrieval Systems in the Generative Era

Invited talk at the Sky Computing Lab, UC Berkeley.

• Slides

Query Performance Prediction: From Fundamentals to Advanced Techniques

Tutorial at ECIR 2024.

• Slides part 1
• Slides part 2

Search Futures from an Evaluation Perspective

Search Futures Workshop at ECIR 2024.

• Slides

Evaluation of Information Retrieval Systems in the Generative Era

Talk at the Search Futures workshop, ECIR 2024.

• Slides

LaQuE: Enabling Entity Search at Scale

Paper presentation at ECIR 2024.

Evaluation of Information Retrieval Systems in the Generative Era

Keynote at the 1st International Workshop on Open Web Search, ECIR 2024.

Gender Fairness in Information Retrieval Systems

Invited talk at the Web Intelligence Group, UCL.

• Slides

Gender Fairness in Information Retrieval Systems

Invited talk at the University of Glasgow Information Retrieval Group.

Gender Fairness in Information Retrieval Systems

Invited talk at the IEEE Women in Engineering Seminar Series.

Gender Fairness in Information Retrieval Systems

Invited talk at the DEFirst Reading Group, MILA × Vector Institute.

Gender Fairness in Information Retrieval Systems

Invited talk at the Spotify SPECS Conference.

A Close Look at MS MARCO Hard Queries and Sparse Labels

Invited talk at the Microsoft Bing Research Group.

• Slides