Publications.

Understanding and Mitigating Gender Bias in Information Retrieval Systems

Shirin Seyedsalehi, Amin Bigdeli, Negar Arabzadeh, Bahaa AlMousavi, Zachary Marshall, Morteza Zihayat, Ebrahim Bagheri

Invited by the editors of Foundations and Trends® in Information Retrieval

Information Access in the Era of Generative AI · contributed chapter: Generative Information Retrieval Evaluation

Marwah Alaofi, Negar Arabzadeh, Charles L. A. Clarke, Mark Sanderson

Edited by Ryen White and Chirag Shah

ReFormeR: Learning and Applying Explicit Query Reformulation Patterns

Amin Bigdeli, Mert Incesu, Negar Arabzadeh, Charles L. A. Clarke, Ebrahim Bagheri

Can LLMs Uphold Research Integrity? Evaluating the Role of LLMs in Peer Review Quality

Negar Arabzadeh, Sajad Ebrahimi, Soroush Sadeghian, Seyed Mohammad Hosseini, Alireza Daqiq, Hai Son Le, Mahdi Bashari, Ebrahim Bagheri

Can QPP Choose the Right Query Variant? Evaluating Query Variant Selection for RAG Pipelines

Negar Arabzadeh, Andrew Drozdov, Michael Bendersky, Matei Zaharia

Failing Forward: Understanding Query Failure in Retrieval, Judgment, and Generation

Seyed Mohammad Hosseini, Negar Arabzadeh, Mohammad Hossein Saliminabi, Morteza Zihayat, Dimitrios Androutsos, Ebrahim Bagheri

From Doxa to Logos in Scientific Peer Review

Negar Arabzadeh, Sajad Ebrahimi, Alireza Daqiq, Soroush Sadeghian, Seyed Mohammad Hosseini, Hai Son Le, Mahdi Bashari, Ebrahim Bagheri

A Reproducibility Study of LLM-Based Query Reformulation

Amin Bigdeli, Radin Hamidi Rad, Hai Son Le, Mert Incesu, Negar Arabzadeh, Charles L. A. Clarke, Ebrahim Bagheri

Peerispect: Claim Verification in Scientific Peer Reviews

Ali Ghorbanpour, Soroush Sadeghian, Amir Daghighfarsoodeh, Sajad Ebrahimi, Negar Arabzadeh, Seyed Mohammad Hosseini, Ebrahim Bagheri

PeerPrism: Peer Evaluation Expertise vs Review-writing AI

Soroush Sadeghian, Alireza Daqiq, Roya Cheraghi, Sajad Ebrahimi, Negar Arabzadeh, Ebrahim Bagheri

Structure-Aware Pre-retrieval Performance Prediction on Query Affinity Graphs

Abbas Saleminezhad, Negar Arabzadeh, Seyed Mohammad Hosseini, Soosan Beheshti, Ebrahim Bagheri

QueryGym: A Toolkit for Reproducible LLM-Based Query Reformulation

Amin Bigdeli, Radin Hamidi Rad, Mert Incesu, Negar Arabzadeh, Charles L. A. Clarke, Ebrahim Bagheri

PeeriScope: A Multi-Faceted Framework for Evaluating Peer Review Quality

Sajad Ebrahimi, Soroush Sadeghian, Ali Ghorbanpour, Negar Arabzadeh, Sara Salamat, Seyed Mohammad Hosseini, Hai Son Le, Mahdi Bashari, Ebrahim Bagheri

Learning Context-aware Term Importance for Query Performance Prediction

Abbas Saleminezhad, Negar Arabzadeh, Soosan Beheshti, Ebrahim Bagheri

Adversarial Attacks against Neural Ranking Models via In-Context Learning

Amin Bigdeli, Negar Arabzadeh, Ebrahim Bagheri, Charles L. A. Clarke

Benchmarking LLM-Based Relevance Judgment Methods

Negar Arabzadeh, Charles L. A. Clarke

A Human-AI Comparative Analysis of Prompt Sensitivity in LLM-Based Relevance Judgment

Negar Arabzadeh, Charles L. A. Clarke

VAP³: Variation-Aware Prompt Performance Prediction

Negar Arabzadeh, Ebrahim Bagheri

IDAT: A Multi-Modal Dataset and Toolkit for Building and Evaluating Interactive Task-Solving Agents

Shrestha Mohanty, Negar Arabzadeh, Andrea Tupini, Yuxuan Sun, Alexey Skrynnik, Artem Zholus, Marc-Alexandre Côté, Julia Kiseleva

LLM-as-a-Judge in Entity Retrieval: Assessing Explicit and Implicit Relevance

Mohammad Hossein Saliminabi, Negar Arabzadeh, Seyed Mohammad Hosseini, Dimitrios Androutsos, Morteza Zihayat, Ebrahim Bagheri

Building Trustworthy Peer Review Quality Assessment Systems

Negar Arabzadeh, Sajad Ebrahimi, Ali Ghorbanpour, Soroush Sadeghian, Sara Salamat, Muhan Li, Hai Son Le, Mahdi Bashari, Ebrahim Bagheri

RottenReviews: Benchmarking Review Quality with Human and LLM-Based Judgments

Sajad Ebrahimi, Soroush Sadeghian, Ali Ghorbanpour, Negar Arabzadeh, Sara Salamat, Muhan Li, Hai Son Le, Mahdi Bashari, Ebrahim Bagheri

Query Performance Prediction Using Neural Query Space Proximity

Amin Bigdeli, Sajad Ebrahimi, Negar Arabzadeh, Sara Salamat, Shirin Seyedsalehi, Maryam Khodabakhsh, Fattane Zarrinkalam, Ebrahim Bagheri

Gender Disentangled Representation Learning in Neural Rankers

Shirin Seyedsalehi, Sara Salamat, Negar Arabzadeh, Sajad Ebrahimi, Morteza Zihayat, Ebrahim Bagheri

A Contrastive Neural Disentanglement Approach for Query Performance Prediction

Sara Salamat, Negar Arabzadeh, Shirin Seyedsalehi, Amin Bigdeli, Morteza Zihayat, Ebrahim Bagheri

Robust Query Performance Prediction for Dense Retrievers via Adaptive Disturbance Generation

Abbas Saleminezhad, Negar Arabzadeh, Radin Hamidi Rad, Soosan Beheshti, Ebrahim Bagheri

exHarmony: Authorship and Citations for Benchmarking the Reviewer Assignment Problem

Sajad Ebrahimi, Sara Salamat, Negar Arabzadeh, Mahdi Bashari, Ebrahim Bagheri

Benchmarking Prompt Sensitivity in Large Language Models

Amirhosein Razavi, Mina Soltangheis, Negar Arabzadeh, Sara Salamat, Morteza Zihayat, Ebrahim Bagheri

Assessing and Verifying Task Utility in LLM-Powered Applications

Negar Arabzadeh, Siqing Huo, Nikhil Mehta, Qingyun Wu, Chi Wang, Ahmed Hassan Awadallah, Charles L. A. Clarke, Julia Kiseleva

Reviewerly: Modeling the Reviewer Assignment Task as an Information Retrieval Problem

Negar Arabzadeh, Sajad Ebrahimi, Sara Salamat, Mahdi Bashari, Ebrahim Bagheri

Evaluating Relative Retrieval Effectiveness with Normalized Residual Gain

Amin Bigdeli, Negar Arabzadeh, Ebrahim Bagheri, Charles L. A. Clarke

Offline Evaluation of Set-Based Text-to-Image Generation

Negar Arabzadeh, Fernando Diaz, Junfeng He

Fréchet Distance for Offline Evaluation of Information Retrieval Systems with Sparse Labels

Negar Arabzadeh, Charles L. A. Clarke

Context-Aware Query Term Difficulty Estimation for Performance Prediction

Abbas Saleminezhad, Negar Arabzadeh, Ebrahim Bagheri, Soosan Beheshti

LaQuE: Enabling Entity Search at Scale

Negar Arabzadeh, Amin Bigdeli, Ebrahim Bagheri

Adapting Standard Retrieval Benchmarks to Evaluate Generated Answers

Negar Arabzadeh, Amin Bigdeli, Charles L. A. Clarke

Estimating Query Performance Through Rich Contextualized Query Representations

Sajad Ebrahimi, Negar Arabzadeh, Fattane Zarrinkalam, Ebrahim Bagheri

Ranked List Truncation: From Retrieval to Re-ranking

Chuan Meng, Negar Arabzadeh, Arian Askari, Mohammad Aliannejadi, Maarten de Rijke

PREME: Preference-Based Meeting Exploration through an Interactive Questionnaire

Negar Arabzadeh, Ali Ahmadvand, Julia Kiseleva, Yang Liu, Ahmed Hassan Awadallah, Ming Zhong, Milad Shokouhi

Noisy Perturbations for Estimating Query Difficulty in Dense Retrievers

Negar Arabzadeh, Radin Hamidi Rad, Maryam Khodabakhsh, Ebrahim Bagheri

Neural Disentanglement of Query Difficulty and Semantics

Sara Salamat, Negar Arabzadeh, Shirin Seyedsalehi, Amin Bigdeli, Morteza Zihayat, Ebrahim Bagheri

Quantifying Ranker Coverage of Different Query Subspaces

Negar Arabzadeh, Amin Bigdeli, Radin Hamidi Rad, Ebrahim Bagheri

Query Performance Prediction: From Ad-Hoc to Conversational Search

Chuan Meng, Negar Arabzadeh, Mohammad Aliannejadi, Maarten de Rijke

A Preference Judgment Tool for Authoritative Assessment

Mahsa Seifikar, Linh Nhi Phan Minh, Negar Arabzadeh, Mark D. Smucker, Charles L. A. Clarke

A is for Adele: An Offline Evaluation Metric for Instant Search

Negar Arabzadeh, Oleksandra Kmet, Ben Carterette, Charles L. A. Clarke, Claudia Hauff, Praveen Chandar

Retrieving Supporting Evidence for LLMs-Generated Answers

Siqing Huo, Negar Arabzadeh, Charles L. A. Clarke

Learning Query-Space Document Representations for High-Recall Retrieval

Sara Salamat, Negar Arabzadeh, Fattane Zarrinkalam, Morteza Zihayat, Ebrahim Bagheri

De-Biasing Relevance Judgements for Fair Ranking

Amin Bigdeli, Negar Arabzadeh, Shirin Seyedsalehi, Morteza Zihayat, Ebrahim Bagheri

Don't Raise Your Voice, Improve Your Argument: Learning to Retrieve Convincing Arguments

Sara Salamat, Negar Arabzadeh, Fattane Zarrinkalam, Morteza Zihayat, Ebrahim Bagheri

Neural Ad-Hoc Retrieval Meets Open Information Extraction

Duong Vo, Fattane Zarrinkalam, Bao Pham, Negar Arabzadeh, Sara Salamat, Ebrahim Bagheri

A Self-Supervised Language Model Selection Strategy for Biomedical Question Answering

Negar Arabzadeh, Ebrahim Bagheri

A Light-Weight Strategy for Restraining Gender Biases in Neural Rankers

Shirin Seyedsalehi, Amin Bigdeli, Negar Arabzadeh, Morteza Zihayat, Ebrahim Bagheri

Interactive Grounded Language Understanding in a Collaborative Environment: Retrospective on IGLU 2022 Competition

Julia Kiseleva, Alexey Skrynnik, Artem Zholus, Shrestha Mohanty, Negar Arabzadeh, Marc-Alexandre Côté, Mohammad Aliannejadi, Milagro Teruel, Ziming Li, Mikhail Burtsev, Maartje ter Hoeve, Zoya Volovikova, Aleksandr Panov, Yuxuan Sun, Kavya Srinet, Arthur Szlam, Ahmed Awadallah, Seungeun Rho, Taehwan Kwon, Daniel Wontae Nam, Felipe Bivort Haiek, Edwin Zhang, Linar Abdrazakov, Guo Qingyam, Jason Zhang, Zhibin Guo

Shallow Pooling for Sparse Labels

Negar Arabzadeh, Alexandra Vtyurina, Xinyi Yan, Charles L. A. Clarke

Unsupervised Question Clarity Prediction Through Retrieved Item Coherency

Negar Arabzadeh, Mahsa Seifikar, Charles L. A. Clarke

Early Stage Sparse Retrieval with Entity Linking

Dahlia Shehata, Negar Arabzadeh, Charles L. A. Clarke

Addressing Gender-Related Performance Disparities in Neural Rankers

Shirin Seyedsalehi, Negar Arabzadeh, Amin Bigdeli, Morteza Zihayat, Ebrahim Bagheri

Bias-Aware Fair Neural Ranking for Addressing Stereotypical Gender Biases

Amin Bigdeli, Negar Arabzadeh, Shirin Seyedsalehi, Morteza Zihayat, Ebrahim Bagheri

Predicting Efficiency / Effectiveness Trade-Offs for Sparse vs. Dense Retrieval Strategy Selection

Negar Arabzadeh, Charles L. A. Clarke, Xinyi Yan

BERT-QPP: Contextualized Pre-Trained Transformers for Query Performance Prediction

Negar Arabzadeh, Maryam Khodabakhsh, Ebrahim Bagheri

Matches Made in Heaven: Toolkit and Large-Scale Datasets for Supervised Query Reformulation

Negar Arabzadeh, Amin Bigdeli, Shirin Seyedsalehi, Morteza Zihayat, Ebrahim Bagheri

MS MARCO Chameleons: Challenging the MS MARCO Leaderboard with Extremely Obstinate Queries

Negar Arabzadeh, Bhaskar Mitra, Ebrahim Bagheri

On the Orthogonality of Bias and Effectiveness in Ad Hoc Retrieval

Amin Bigdeli, Negar Arabzadeh, Shirin Seyedsalehi, Morteza Zihayat, Ebrahim Bagheri

WaterlooClarke at the TREC 2021 Conversational Assistant Track

Xinyi Yan, Charles L. A. Clarke, Negar Arabzadeh

Query Performance Prediction Through Retrieval Coherency

Negar Arabzadeh, Amin Bigdeli, Morteza Zihayat, Ebrahim Bagheri

Exploring Gender Biases in Information Retrieval Relevance Judgement Datasets

Amin Bigdeli, Negar Arabzadeh, Morteza Zihayat, Ebrahim Bagheri

WaterlooClarke at the TREC 2020 Conversational Assistant Track

Negar Arabzadeh, Charles L. A. Clarke

Neural Embedding-Based Specificity Metrics for Pre-Retrieval Query Performance Prediction

Negar Arabzadeh, Fattane Zarrinkalam, Jelena Jovanovic, Feras Al-Obeidat, Ebrahim Bagheri

Neural Embedding-Based Metrics for Pre-Retrieval Query Performance Prediction

Negar Arabzadeh, Fattane Zarrinkalam, Jelena Jovanovic, Ebrahim Bagheri

Geometric Estimation of Specificity within Embedding Spaces

Negar Arabzadeh, Fattane Zarrinkalam, Jelena Jovanovic, Ebrahim Bagheri

Causal Dependencies for Future Interest Prediction on Twitter

Negar Arabzadeh, Hossein Fani, Fattane Zarrinkalam, Ahmed Navivala, Ebrahim Bagheri