Evaluating Cognitive Maps and Planning in Large Language Models with CogEval
Ida Momennejad, Hosein Hasanbeig, Felipe Vieira Frujeri, Hiteshi Sharma, Robert Osazuwa Ness, Nebojsa Jojic, Hamid Palangi, Jonathan Larson
NeurIPS 2023 | October 2023
Ida Momennejad
Principal Researcher in Reinforcement Learning
Publications
Publications by Year
-
A Prefrontal Cortex-inspired Architecture for Planning in Large Language Models
Taylor Webb, S. S. Mondal, Chi Wang, Brian Krabach, Ida Momennejad
September 2023
In-Context Learning in Large Language Models: A Neuroscience-inspired Analysis of Representations
Safoora Yousefi, Leo Betthauser, Hosein Hasanbeig, Akanksha Saran, Raphael Milliere, Ida Momennejad
September 2023
Imitating Human Behaviour with Diffusion Models
Tim Pearce, Tabish Rashid, Anssi Kanervisto, Dave Bignell, Mingfei Sun, Raluca Georgescu, Sergio Valcarcel Macua, Shanzheng Tan, Ida Momennejad, Katja Hofmann, Sam Devlin
ICLR 2023 | May 2023
Navigates Like Me: Understanding How People Evaluate Human-Like AI in Video Games
Stephanie Milani, Arthur Juliani, Ida Momennejad, Raluca Georgescu, Jaroslaw Rzepecki, Alison Shaw, Gavin Costello, Fei Fang, Sam Devlin, Katja Hofmann
CHI | April 2023
-
Interaction-Grounded Learning with Action-Inclusive Feedback
Tengyang Xie, Akanksha Saran, Dylan J Foster, Lekan P Molu, Ida Momennejad, Nan Jiang, Paul Mineiro, John Langford
NeurIPS 2022 | November 2022
Towards Evaluating Adaptivity of Model-Based Reinforcement Learning Methods
Yi Wan, Harm van Seijen, Ida Momennejad, Sarath Chandar, Janarthanan Rajendran, Ali Rahimi-Kalahroudi
ICML 2022 | July 2022
How Humans Perceive Human-like Behavior in Video Game Navigation
Evelyn Zuniga, Stephanie Milani, Guy Leroy, Jaroslaw Rzepecki, Raluca Georgescu, Ida Momennejad, Dave Bignell, Mingfei Sun, Alison Shaw, Gavin Costello, Mikhail Jacob, Sam Devlin, Katja Hofmann
CHI 2022 | April 2022
Predictive Representations in Hippocampal and Prefrontal Hierarchies
Iva K. Brunec, Ida Momennejad
Journal of Neuroscience | January 2022, Vol 42(2): pp. 299-312
-
Navigation Turing Test (NTT): Learning to Evaluate Human-Like Navigation
Sam Devlin, Raluca Georgescu, Ida Momennejad, Jaroslaw Rzepecki, Evelyn Zuniga, Gavin Costello, Guy Leroy, Ali Shaw, Katja Hofmann
2021 International Conference on Machine Learning | July 2021
Source code available at: https://github.com/microsoft/NTT
Interaction-Grounded Learning
Tengyang Xie, John Langford, Paul Mineiro, Ida Momennejad
2021 International Conference on Machine Learning | July 2021
-
The successor representation in human reinforcement learning
Ida Momennejad, E. M. Russek, J. H. Cheong, M. M. Botvinick, N. D. Daw, S. J. Gershman
Nature Human Behaviour | September 2017, Vol 1: pp. 680-692
-
Encoding of Prospective Tasks in the Human Prefrontal Cortex under Varying Task Loads
Ida Momennejad, John-Dylan Haynes
Journal of Neuroscience | October 2013, Vol 33(44): pp. 17342-17349
Publications by Research Area
-
Evaluating Cognitive Maps and Planning in Large Language Models with CogEval
Ida Momennejad, Hosein Hasanbeig, Felipe Vieira Frujeri, Hiteshi Sharma, Robert Osazuwa Ness, Nebojsa Jojic, Hamid Palangi, Jonathan Larson
NeurIPS 2023 | October 2023
In-Context Learning in Large Language Models: A Neuroscience-inspired Analysis of Representations
Safoora Yousefi, Leo Betthauser, Hosein Hasanbeig, Akanksha Saran, Raphael Milliere, Ida Momennejad
September 2023
A Prefrontal Cortex-inspired Architecture for Planning in Large Language Models
Taylor Webb, S. S. Mondal, Chi Wang, Brian Krabach, Ida Momennejad
September 2023
Imitating Human Behaviour with Diffusion Models
Tim Pearce, Tabish Rashid, Anssi Kanervisto, Dave Bignell, Mingfei Sun, Raluca Georgescu, Sergio Valcarcel Macua, Shanzheng Tan, Ida Momennejad, Katja Hofmann, Sam Devlin
ICLR 2023 | May 2023
Navigates Like Me: Understanding How People Evaluate Human-Like AI in Video Games
Stephanie Milani, Arthur Juliani, Ida Momennejad, Raluca Georgescu, Jaroslaw Rzepecki, Alison Shaw, Gavin Costello, Fei Fang, Sam Devlin, Katja Hofmann
CHI | April 2023
Interaction-Grounded Learning with Action-Inclusive Feedback
Tengyang Xie, Akanksha Saran, Dylan J Foster, Lekan P Molu, Ida Momennejad, Nan Jiang, Paul Mineiro, John Langford
NeurIPS 2022 | November 2022
Towards Evaluating Adaptivity of Model-Based Reinforcement Learning Methods
Yi Wan, Harm van Seijen, Ida Momennejad, Sarath Chandar, Janarthanan Rajendran, Ali Rahimi-Kalahroudi
ICML 2022 | July 2022
Predictive Representations in Hippocampal and Prefrontal Hierarchies
Iva K. Brunec, Ida Momennejad
Journal of Neuroscience | January 2022, Vol 42(2): pp. 299-312
Navigation Turing Test (NTT): Learning to Evaluate Human-Like Navigation
Sam Devlin, Raluca Georgescu, Ida Momennejad, Jaroslaw Rzepecki, Evelyn Zuniga, Gavin Costello, Guy Leroy, Ali Shaw, Katja Hofmann
2021 International Conference on Machine Learning | July 2021
Source code available at: https://github.com/microsoft/NTT
Interaction-Grounded Learning
Tengyang Xie, John Langford, Paul Mineiro, Ida Momennejad
2021 International Conference on Machine Learning | July 2021
The successor representation in human reinforcement learning
Ida Momennejad, E. M. Russek, J. H. Cheong, M. M. Botvinick, N. D. Daw, S. J. Gershman
Nature Human Behaviour | September 2017, Vol 1: pp. 680-692
Encoding of Prospective Tasks in the Human Prefrontal Cortex under Varying Task Loads
Ida Momennejad, John-Dylan Haynes
Journal of Neuroscience | October 2013, Vol 33(44): pp. 17342-17349
-
Predictive Representations in Hippocampal and Prefrontal Hierarchies
Iva K. Brunec, Ida Momennejad
Journal of Neuroscience | January 2022, Vol 42(2): pp. 299-312
-
Evaluating Cognitive Maps and Planning in Large Language Models with CogEval
Ida Momennejad, Hosein Hasanbeig, Felipe Vieira Frujeri, Hiteshi Sharma, Robert Osazuwa Ness, Nebojsa Jojic, Hamid Palangi, Jonathan Larson
NeurIPS 2023 | October 2023
-
How Humans Perceive Human-like Behavior in Video Game Navigation
Evelyn Zuniga, Stephanie Milani, Guy Leroy, Jaroslaw Rzepecki, Raluca Georgescu, Ida Momennejad, Dave Bignell, Mingfei Sun, Alison Shaw, Gavin Costello, Mikhail Jacob, Sam Devlin, Katja Hofmann
CHI 2022 | April 2022
Publications by Type
-
Predictive Representations in Hippocampal and Prefrontal Hierarchies
Iva K. Brunec, Ida Momennejad
Journal of Neuroscience | January 2022, Vol 42(2): pp. 299-312
The successor representation in human reinforcement learning
Ida Momennejad, E. M. Russek, J. H. Cheong, M. M. Botvinick, N. D. Daw, S. J. Gershman
Nature Human Behaviour | September 2017, Vol 1: pp. 680-692
Encoding of Prospective Tasks in the Human Prefrontal Cortex under Varying Task Loads
Ida Momennejad, John-Dylan Haynes
Journal of Neuroscience | October 2013, Vol 33(44): pp. 17342-17349
-
In-Context Learning in Large Language Models: A Neuroscience-inspired Analysis of Representations
Safoora Yousefi, Leo Betthauser, Hosein Hasanbeig, Akanksha Saran, Raphael Milliere, Ida Momennejad
September 2023
A Prefrontal Cortex-inspired Architecture for Planning in Large Language Models
Taylor Webb, S. S. Mondal, Chi Wang, Brian Krabach, Ida Momennejad
September 2023
-
Evaluating Cognitive Maps and Planning in Large Language Models with CogEval
Ida Momennejad, Hosein Hasanbeig, Felipe Vieira Frujeri, Hiteshi Sharma, Robert Osazuwa Ness, Nebojsa Jojic, Hamid Palangi, Jonathan Larson
NeurIPS 2023 | October 2023
Imitating Human Behaviour with Diffusion Models
Tim Pearce, Tabish Rashid, Anssi Kanervisto, Dave Bignell, Mingfei Sun, Raluca Georgescu, Sergio Valcarcel Macua, Shanzheng Tan, Ida Momennejad, Katja Hofmann, Sam Devlin
ICLR 2023 | May 2023
Navigates Like Me: Understanding How People Evaluate Human-Like AI in Video Games
Stephanie Milani, Arthur Juliani, Ida Momennejad, Raluca Georgescu, Jaroslaw Rzepecki, Alison Shaw, Gavin Costello, Fei Fang, Sam Devlin, Katja Hofmann
CHI | April 2023
Interaction-Grounded Learning with Action-Inclusive Feedback
Tengyang Xie, Akanksha Saran, Dylan J Foster, Lekan P Molu, Ida Momennejad, Nan Jiang, Paul Mineiro, John Langford
NeurIPS 2022 | November 2022
Towards Evaluating Adaptivity of Model-Based Reinforcement Learning Methods
Yi Wan, Harm van Seijen, Ida Momennejad, Sarath Chandar, Janarthanan Rajendran, Ali Rahimi-Kalahroudi
ICML 2022 | July 2022
How Humans Perceive Human-like Behavior in Video Game Navigation
Evelyn Zuniga, Stephanie Milani, Guy Leroy, Jaroslaw Rzepecki, Raluca Georgescu, Ida Momennejad, Dave Bignell, Mingfei Sun, Alison Shaw, Gavin Costello, Mikhail Jacob, Sam Devlin, Katja Hofmann
CHI 2022 | April 2022
Navigation Turing Test (NTT): Learning to Evaluate Human-Like Navigation
Sam Devlin, Raluca Georgescu, Ida Momennejad, Jaroslaw Rzepecki, Evelyn Zuniga, Gavin Costello, Guy Leroy, Ali Shaw, Katja Hofmann
2021 International Conference on Machine Learning | July 2021
Source code available at: https://github.com/microsoft/NTT
Interaction-Grounded Learning
Tengyang Xie, John Langford, Paul Mineiro, Ida Momennejad
2021 International Conference on Machine Learning | July 2021