Hybrid Models
Related Papers
2026
arXiv 2026
From Local Corrections to Generalized Skills: Improving Neuro-Symbolic Policies with MEMO
Benjamin A. Christie, Yinlong Dai, Mohammad Bararjanianbahnamiri, Simon Stepputtis, Dylan P. Losey
arXiv Preprint
arXiv 2026
Language Movement Primitives: Grounding Language Models in Robot Motion
Yinlong Dai, Benjamin A. Christie, Daniel J. Evans, Dylan P. Losey, Simon Stepputtis
arXiv Preprint
AAAI 2026
LieCraft: A Multi-Agent Framework for Evaluating Deceptive Capabilities in Language Models
Matthew Lyle Olson, Neale Ratzlaff, Musashi Hinck, Tri Nguyen, Vasudev Lal, Joseph Campbell, Simon Stepputtis, Shao{-}Yen Tseng
Fortieth {AAAI} Conference on Artificial Intelligence, Thirty-Eighth
Conference on Innovative Applications of Artificial Intelligence,
Sixteenth Symposium on Educational Advances in Artificial Intelligence,
{AAAI} 2026, Singapore, January 20-27, 2026
arXiv 2026
LieCraft: A Multi-Agent Framework for Evaluating Deceptive Capabilities in Language Models
Matthew Lyle Olson, Neale Ratzlaff, Musashi Hinck, Tri Nguyen, Vasudev Lal, Joseph Campbell, Simon Stepputtis, Shao{-}Yen Tseng
arXiv Preprint
arXiv 2026
SCALAR: Learning and Composing Skills through LLM Guided Symbolic Planning and Deep RL Grounding
Renos Zabounidis, Yue Wu, Simon Stepputtis, Woojun Kim, Yuanzhi Li, Tom Mitchell, Katia Sycara
arXiv Preprint
arXiv 2026
Theory of Mind Guided Strategy Adaptation for Zero-Shot Coordination
Andrew Ni, Simon Stepputtis, Stefanos Nikolaidis, Michael Lewis, Katia P. Sycara, Woojun Kim
arXiv Preprint
2025
arXiv 2025
Adaptively Coordinating with Novel Partners via Learned Latent Strategies
Benjamin Li, Shuyang Shi, Lucia Romero, Huao Li, Yaqi Xie, Woojun Kim, Stefanos Nikolaidis, Michael Lewis, Katia Sycara, Simon Stepputtis
arXiv Preprint
arXiv 2025
Bayesian Social Deduction with Graph-Informed Language Models
Shahab Rahimirad, Guven Gergerli, Lucia Romero, Angela Qian, Matthew Lyle Olson, Simon Stepputtis, Joseph Campbell
arXiv Preprint
ACL 2025
InstructPart: Task-Oriented Part Segmentation with Instruction Reasoning
Zifu Wan, Yaqi Xie, Ce Zhang, Zhiqiu Lin, Zihan Wang, Simon Stepputtis, Deva Ramanan, Katia P. Sycara
Proceedings of the 63rd Annual Meeting of the Association for Computational
Linguistics (Volume 1: Long Papers), {ACL} 2025, Vienna, Austria,
July 27 - August 1, 2025
arXiv 2025
InstructPart: Task-Oriented Part Segmentation with Instruction Reasoning
Zifu Wan, Yaqi Xie, Ce Zhang, Zhiqiu Lin, Zihan Wang, Simon Stepputtis, Deva Ramanan, Katia P. Sycara
arXiv Preprint
arXiv 2025
Modeling Latent Partner Strategies for Adaptive Zero-Shot Human-Agent Collaboration
Benjamin Li, Shuyang Shi, Lucia Romero, Huao Li, Yaqi Xie, Woojun Kim, Stefanos Nikolaidis, Michael Lewis, Katia P. Sycara, Simon Stepputtis
arXiv Preprint
ICCV 2025
ONLY: One-Layer Intervention Sufficiently Mitigates Hallucinations in Large Vision-Language Models
Zifu Wan, Ce Zhang, Silong Yong, Martin Q. Ma, Simon Stepputtis, Louis{-}Philippe Morency, Deva Ramanan, Katia Sycara, Yaqi Xie
{IEEE/CVF} International Conference on Computer Vision, {ICCV} 2025,
Honolulu, HI, USA, October 19-25, 2025
ICLR 2025
Self-Correcting Decoding with Generative Feedback for Mitigating Hallucinations in Large Vision-Language Models
Ce Zhang, Zifu Wan, Zhehan Kan, Martin Q. Ma, Simon Stepputtis, Deva Ramanan, Russ Salakhutdinov, Louis{-}Philippe Morency, Katia P. Sycara, Yaqi Xie
The Thirteenth International Conference on Learning Representations,
{ICLR} 2025, Singapore, April 24-28, 2025
arXiv 2025
Self-Correcting Decoding with Generative Feedback for Mitigating Hallucinations in Large Vision-Language Models
Ce Zhang, Zifu Wan, Zhehan Kan, Martin Q. Ma, Simon Stepputtis, Deva Ramanan, Russ Salakhutdinov, Louis{-}Philippe Morency, Katia P. Sycara, Yaqi Xie
arXiv Preprint
WACV 2025
Sigma: Siamese Mamba Network for Multi-Modal Semantic Segmentation
Zifu Wan, Pingping Zhang, Yuhao Wang, Silong Yong, Simon Stepputtis, Katia P. Sycara, Yaqi Xie
{IEEE/CVF} Winter Conference on Applications of Computer Vision, {WACV}
2025, Tucson, AZ, USA, February 26 - March 6, 2025
arXiv 2025
Speaking the Language of Teamwork: LLM-Guided Credit Assignment in Multi-Agent Reinforcement Learning
Muhan Lin, Shuyang Shi, Yue Guo, Vaishnav Tadiparthi, Behdad Chalaki, Ehsan Moradi{-}Pari, Simon Stepputtis, Woojun Kim, Joseph Campbell, Katia P. Sycara
arXiv Preprint
2024
NeurIPS 2024
Dual Prototype Evolving for Test-Time Generalization of Vision-Language Models
Ce Zhang, Simon Stepputtis, Katia P. Sycara, Yaqi Xie
Advances in Neural Information Processing Systems 38: Annual Conference
on Neural Information Processing Systems 2024, NeurIPS 2024, Vancouver,
BC, Canada, December 10 - 15, 2024
arXiv 2024
Dual Prototype Evolving for Test-Time Generalization of Vision-Language Models
Ce Zhang, Simon Stepputtis, Katia P. Sycara, Yaqi Xie
arXiv Preprint
CVPR 2024
HiKER-SGG: Hierarchical Knowledge Enhanced Robust Scene Graph Generation
Ce Zhang, Simon Stepputtis, Joseph Campbell, Katia P. Sycara, Yaqi Xie
{IEEE/CVF} Conference on Computer Vision and Pattern Recognition,
{CVPR} 2024, Seattle, WA, USA, June 16-22, 2024
arXiv 2024
HiKER-SGG: Hierarchical Knowledge Enhanced Robust Scene Graph Generation
Ce Zhang, Simon Stepputtis, Joseph Campbell, Katia P. Sycara, Yaqi Xie
arXiv Preprint
RAL 2024
Let Me Help You! Neuro-Symbolic Short-Context Action Anticipation
Sarthak Bhagat, Samuel Li, Joseph Campbell, Yaqi Xie, Katia P. Sycara, Simon Stepputtis
{IEEE} Robotics Autom. Lett.
NeurIPS 2024
LogiCity: Advancing Neuro-Symbolic AI with Abstract Urban Simulation
Bowen Li, Zhaoyu Li, Qiwei Du, Jinqi Luo, Wenshan Wang, Yaqi Xie, Simon Stepputtis, Chen Wang, Katia P. Sycara, Pradeep Ravikumar, Alexander G. Gray, Xujie Si, Sebastian A. Scherer
Advances in Neural Information Processing Systems 38: Annual Conference
on Neural Information Processing Systems 2024, NeurIPS 2024, Vancouver,
BC, Canada, December 10 - 15, 2024
arXiv 2024
LogiCity: Advancing Neuro-Symbolic AI with Abstract Urban Simulation
Bowen Li, Zhaoyu Li, Qiwei Du, Jinqi Luo, Wenshan Wang, Yaqi Xie, Simon Stepputtis, Chen Wang, Katia P. Sycara, Pradeep Kumar Ravikumar, Alexander G. Gray, Xujie Si, Sebastian A. Scherer
arXiv Preprint
arXiv 2024
Negative Yields Positive: Unified Dual-Path Adapter for Vision-Language Models
Ce Zhang, Simon Stepputtis, Katia P. Sycara, Yaqi Xie
arXiv Preprint
IROS 2024
ShapeGrasp: Zero-Shot Task-Oriented Grasping with Large Language Models through Geometric Decomposition
Samuel Li, Sarthak Bhagat, Joseph Campbell, Yaqi Xie, Woojun Kim, Katia P. Sycara, Simon Stepputtis
{IEEE/RSJ} International Conference on Intelligent Robots and Systems,
{IROS} 2024, Abu Dhabi, United Arab Emirates, October 14-18, 2024
arXiv 2024
ShapeGrasp: Zero-Shot Task-Oriented Grasping with Large Language Models through Geometric Decomposition
Samuel Li, Sarthak Bhagat, Joseph Campbell, Yaqi Xie, Woojun Kim, Katia P. Sycara, Simon Stepputtis
arXiv Preprint
arXiv 2024
Sigma: Siamese Mamba Network for Multi-Modal Semantic Segmentation
Zifu Wan, Yuhao Wang, Silong Yong, Pingping Zhang, Simon Stepputtis, Katia P. Sycara, Yaqi Xie
arXiv Preprint
arXiv 2024
Symbolic Graph Inference for Compound Scene Understanding
FNU Aryan, Simon Stepputtis, Sarthak Bhagat, Joseph Campbell, Kwonjoon Lee, Hossein Nourkhiz Mahjoub, Katia P. Sycara
arXiv Preprint
2023
arXiv 2023
Benchmarking and Enhancing Disentanglement in Concept-Residual Models
Renos Zabounidis, Ini Oguntola, Konghao Zhao, Joseph Campbell, Simon Stepputtis, Katia P. Sycara
arXiv Preprint
arXiv 2023
Explaining Agent Behavior with Large Language Models
Xijia Zhang, Yue Guo, Simon Stepputtis, Katia P. Sycara, Joseph Campbell
arXiv Preprint
CoLLAs 2023
Introspective Action Advising for Interpretable Transfer Learning
Joseph Campbell, Yue Guo, Fiona Xie, Simon Stepputtis, Katia P. Sycara
Conference on Lifelong Learning Agents, 22-25 August 2023, McGill
University, Montr{\'{e}}al, Qu{\'{e}}bec, Canada
arXiv 2023
Introspective Action Advising for Interpretable Transfer Learning
Joseph Campbell, Yue Guo, Fiona Xie, Simon Stepputtis, Katia P. Sycara
arXiv Preprint
AuRo 2023
Learning modular language-conditioned robot policies through attention
Yifan Zhou, Shubham D. Sonawani, Mariano J. Phielipp, Heni Ben Amor, Simon Stepputtis
Auton. Robots
EMNLP 2023
Long-Horizon Dialogue Understanding for Role Identification in the Game of Avalon with Large Language Models
Simon Stepputtis, Joseph Campbell, Yaqi Xie, Zhengyang Qi, Wenxin Sharon Zhang, Ruiyi Wang, Sanketh Rangreji, Charles Lewis, Katia P. Sycara
Findings of the Association for Computational Linguistics: {EMNLP}
2023, Singapore, December 6-10, 2023
arXiv 2023
Long-Horizon Dialogue Understanding for Role Identification in the Game of Avalon with Large Language Models
Simon Stepputtis, Joseph Campbell, Yaqi Xie, Zhengyang Qi, Wenxin Sharon Zhang, Ruiyi Wang, Sanketh Rangreji, Michael Lewis, Katia P. Sycara
arXiv Preprint
arXiv 2023
Theory of Mind as Intrinsic Motivation for Multi-Agent Reinforcement Learning
Ini Oguntola, Joseph Campbell, Simon Stepputtis, Katia P. Sycara
arXiv Preprint
EMNLP 2023
Theory of Mind for Multi-Agent Collaboration via Large Language Models
Huao Li, Yu Quan Chong, Simon Stepputtis, Joseph Campbell, Dana Hughes, Charles Lewis, Katia P. Sycara
Proceedings of the 2023 Conference on Empirical Methods in Natural
Language Processing, {EMNLP} 2023, Singapore, December 6-10, 2023
arXiv 2023
Theory of Mind for Multi-Agent Collaboration via Large Language Models
Huao Li, Yu Quan Chong, Simon Stepputtis, Joseph Campbell, Dana Hughes, Michael Lewis, Katia P. Sycara
arXiv Preprint
arXiv 2023
Understanding Your Agent: Leveraging Large Language Models for Behavior Explanation
Xijia Zhang, Yue Guo, Simon Stepputtis, Katia P. Sycara, Joseph Campbell
arXiv Preprint
2022
CoRL 2022
Concept Learning for Interpretable Multi-Agent Reinforcement Learning
Renos Zabounidis, Joseph Campbell, Simon Stepputtis, Dana Hughes, Katia P. Sycara
Conference on Robot Learning, CoRL 2022, 14-18 December 2022, Auckland,
New Zealand
arXiv 2022
Explainable Action Advising for Multi-Agent Reinforcement Learning
Yue Guo, Joseph Campbell, Simon Stepputtis, Ruiyu Li, Dana Hughes, Fei Fang, Katia P. Sycara
arXiv Preprint
2019
arXiv 2019
Probabilistic Multimodal Modeling for Human-Robot Interaction Tasks
Joseph Campbell, Simon Stepputtis, Heni Ben Amor
arXiv Preprint