Awesome-Neuro-Symbolic-Learning-with-LLM

✨✨ Curated collection of papers and resources on latest Advances on Neuro-Symbolic Learning in the Era of Large Language Model

🗂️ Table of Contents

1. Awesome Tutorials & Workshops & Talks
2. Awesome Survey
3. Awesome Papers
• Basic Neuro-Symbolic Frameworks
• LLM for Neuro-Symbolic Learning
• Neuro-Symbolic Learning for LLM Reasoning
• Neuro-Symbolic Learning for Planning
• Neuro-Symbolic Learning for the Explainable & Trustworthy
• Neuro-Symbolic Learning for Visual Reasoning
• Neuro-Symbolic Learning for Math Reasoning
• Neuro-Symbolic Learning for Reinforcement Learning
• Neuro-Symbolic Learning for Embodied AI
• Neuro-Symbolic Learning for Agent
• Neuro-Symbolic Learning for AIGC
• Misc
4. Awesome Datasets & Benchmarks

Awesome Tutorials & Workshops & Talks

• Summer School on Neurosymbolic Programming
• Advances in Neuro Symbolic Reasoning and Learning Tutorials in AAAI 2023
• Neuro-Symbolic Methods for Language and Vision Tutorials in AAAI 2022
• Neuro-Symbolic Approaches: Large Language Models + Tool Use Tutorials in ACL 2023
• Neuro-Symbolic Visual Reasoning and Program Synthesis Tutorials in CVPR 2020
• Neuro-Symbolic Generative Models Workshop in ICLR 2023
• Neuro-Symbolic Learning and Reasoning in the Era of Large Language Models Workshop in AAAI 2024
• MIT 6.S191: Neuro-Symbolic AI Talk given by David Cox [Video]
• Neuro-Symbolic Concepts for Robotic Manipulation Talk given by Jiayuan Mao [Video]
• Building General-Purpose Robots with Compositional Action Abstractions Talk given by Jiayuan Mao

Awesome Survey

• Neuro-Symbolic AI: The 3rd Wave
• Neuro-Symbolic AI and its Taxonomy: A Survey
• The third AI summer: AAAI Robert S. Engelmore Memorial Lecture
• Neurosymbolic AI - Why, What, and How
• From Statistical Relational to Neuro-Symbolic Artificial Intelligence: a Survey
• Neuro-Symbolic Artificial Intelligence: Current Trends
• A Review on Neuro-symbolic AI Improvements to Natural Language Processing
• Survey on Applications of Neurosymbolic Artificial Intelligence
• Neurosymbolic Programming [Slides]
• Overview of Neuro-Symbolic Integration Frameworks

Awesome Papers

Basic Neuro-Symbolic Frameworks

Title	Venue	Date	Code
Semantic-based regularization for learning and inference	Artificial Intelligence	2017	-
DeepProbLog: Neural Probabilistic Logic Programming	NeurIPS	2018	Github
Learning Explanatory Rules from Noisy Data	Journal of Artificial Intelligence Research	2018	Github
Augmenting Neural Networks with First-order Logic	ACL	2019	-
Neural Logic Machines	ICLR	2019	Github
Bridging Machine Learning and Logical Reasoning by Abductive Learning	NeurIPS	2019	Github
SATNet: Bridging deep learning and logical reasoning using a differentiable satisfiability solver	ICML	2019	Github
DL2: Training and Querying Neural Networks with Logic	ICML	2019	Github
The Neuro-Symbolic Concept Learner: Interpreting Scenes, Words, and Sentences From Natural Supervision	ICLR	2019	Github
NeurASP: Embracing Neural Networks into Answer Set Programming	IJCAI	2020	Github
Learning programs by learning from failures	Machine Learning	2020	-
Logical Neural Networks	Arxiv	2020	Github
Closed Loop Neural-Symbolic Learning via Integrating Neural Perception, Grammar Parsing, and Symbolic Reasoning	ICML	2020	Github
Ontology Reasoning with Deep Neural Networks	Artificial Intelligence	2020	-
MultiplexNet: Towards Fully Satisfied Logical Constraints in Neural Networks	AAAI	2022	-
Neuro-Symbolic Hierarchical Rule Induction	ICML	2022	-
Logic Tensor Networks	Artificial Intelligence	2022	Github
Neuro-symbolic Learning Yielding Logical Constraints	NeurIPS	2023	Github
Neural-Symbolic Recursive Machine for Systematic Generalization	ICLR	2024	Github

LLM for Neuro-Symbolic Learning

Title	Venue	Date	Code
Evaluating Large Language Models Trained on Code	Arxiv	2021	Github
Autoformalization with Large Language Models	NeurIPS	2022	-
MRKL Systems: A modular, neuro-symbolic architecture that combines large language models, external knowledge sources and discrete reasoning	Arxiv	2022	-
Symbol-LLM: Leverage Language Models for Symbolic System in Visual Human Activity Reasoning	NeurIPS	2023	Github
Large Language Models Are Neurosymbolic Reasoners	AAAI	2024	Github
AutoSAT: Automatically Optimize SAT Solvers via Large Language Models	Arxiv	2024	-
Leveraging Environment Interaction for Automated PDDL Translation and Planning with Large Language Models	NeurIPS	2024	Github
A Foundation Model for Zero-shot Logical Query Reasoning	NeurIPS	2024	-

Neuro-Symbolic Learning for LLM Reasoning

Title	Venue	Date	Code
PTR: Prompt Tuning with Rules for Text Classification	Arxiv	2021	Github
A Generative-Symbolic Model for Logical Reasoning in NLU	IJCAI Workshop	2021	-
NeuroLogic Decoding: (Un)supervised Neural Text Generation with Predicate Logic Constraints	ACL	2021	-
NeuroLogic A-star Decoding: Constrained Text Generation with Lookahead Heuristics	ACL	2022	-
Logic-Driven Context Extension and Data Augmentation for Logical Reasoning of Text	ACL	2022	Github
PAL: Program-aided Language Models	ICML	2023	Github
LLM Sandwich: NeuroSymbolic Approach to Solving Complex Reasoning Problem	ACL	2023	Github
Logic-LM: Empowering Large Language Models with Symbolic Solvers for Faithful Logical Reasoning	EMNLP	2023	Github
LINC: A Neurosymbolic Approach for Logical Reasoning by Combining Language Models with First-Order Logic Provers	EMNLP	2023	Github
Program of Thoughts Prompting: Disentangling Computation from Reasoning for Numerical Reasoning Tasks	TMLR	2023	Github
Leveraging Large Language Models to Generate Answer Set Programs	KR	2023	-
Reasoning with Language Model is Planning with World Model	ACL	2023	-
Faithful Logical Reasoning via Symbolic Chain-of-Thought	ACL	2023	Github
Binding Language Models in Symbolic Languages	ICLR	2023	Github
SATLM: Satisfiability-Aided Language Models Using Declarative Prompting	NeurIPS	2023	Github
StackSight: Unveiling WebAssembly through Large Language Models and Neurosymbolic Chain-of-Thought Decompilation	ICML	2024	-
Leveraging LLMs for Hypothetical Deduction in Logical Inference: A Neuro-Symbolic Approach	Arxiv	2024	-
Towards LogiGLUE: A Brief Survey and A Benchmark for Analyzing Logical Reasoning Capabilities of Language Models	Arxiv	2024	-
Neuro-Symbolic Integration Brings Causal and Reliable Reasoning Proofs	Arxiv	2024	Github
SAC-KG: Exploiting Large Language Models as Skilled Automatic Constructors for Domain Knowledge Graphs	ACL	2024	-
Natural Language Embedded Programs for Hybrid Language Symbolic Reasoning	ACL	2024	Github
Prototype-then-Refine: A Neuro-Symbolic Approach for Improved Logical Reasoning with LLMs	Arxiv	2024	-
Premise Order Matters in Reasoning with Large Language Models	ICML	2024	-
LogicAsker: Evaluating and Improving the Logical Reasoning Ability of Large Language Models	EMNLP	2024	Github
Language Models can be Logical Solvers	ACL	2024	-
Abstract Meaning Representation-Based Logic-Driven Data Augmentation for Logical Reasoning	ACL	2024	Github
Learning to Reason via Program Generation, Emulation, and Search	NeurIPS	2024	Github
Learning to Reason Iteratively and Parallelly for Complex Visual Reasoning Scenarios	NeurIPS	2024	Github
Enhancing Reasoning Capabilities of LLMs via Principled Synthetic Logic Corpus	NeurIPS	2024	-
Adaptable Logical Control for Large Language Models	NeurIPS	2024	-
Rule Based Rewards for Language Model Safety	NeurIPS	2024	-
Rule Extrapolation in Language Models: A Study of Compositional Generalization on OOD Prompts	NeurIPS	2024	-
KnowGPT: Knowledge Graph based PrompTing for Large Language Models	NeurIPS	2024	-
Reasoning on Graphs: Faithful and Interpretable Large Language Model Reasoning	ICLR	2024	-

Neuro-Symbolic Learning for Planning

Title	Venue	Date	Code
PDDL Planning with Pretrained Large Language Models	NeurIPS Workshop	2022	Github
Leveraging Pre-trained Large Language Models to Construct and Utilize World Models for Model-based Task Planning	NeurIPS	2023	Github
LLM+P: Empowering Large Language Models with Optimal Planning Proficiency	Arxiv	2023	Github
Learning Rational Subgoals from Demonstrations and Instructions	AAAI	2023	Github
Planning with Large Language Models for Code Generation	ICLR	2023	Github
Neuro-Symbolic Procedural Planning with Commonsense Prompting	ICLR	2023	Github
Why Not Use Your Textbook? Knowledge-Enhanced Procedure Planning of Instructional Videos	CVPR	2024	Github
Learning Planning Abstractions from Language	ICLR	2024	-
Generalized Planning in PDDL Domains with Pretrained Large Language Models	AAAI	2024	-

Neuro-Symbolic Learning for the Explainable & Trustworthy

Title	Venue	Date	Code
An Interpretable Neuro-Symbolic Reasoning Framework for Task-Oriented Dialogue Generation	ACL	2022	Github
Bridging the Gap: Providing Post-Hoc Symbolic Explanations for Sequential Decision-Making Problems with Inscrutable Representations	NeurIPS	2022	-
Interpretable Neural-Symbolic Concept Reasoning	ICML	2023	-

Neuro-Symbolic Learning for Visual Reasoning

Title	Venue	Date	Code
Neural-Symbolic VQA: Disentangling Reasoning from Vision and Language Understanding	NeurIPS	2018	Github
Probabilistic Neural-symbolic Models for Interpretable Visual Question Answering	ICML	2019	-
Visual Concept-MetaConcept Learning	NeurIPS	2019	Github
The Neuro-Symbolic Concept Learner: Interpreting Scenes, Words, and Sentences From Natural Supervision	ICLR	2019	Github
Learning to Describe Scenes with Programs	ICLR	2019	-
Learning to Infer and Execute 3D Shape Programs	ICLR	2019	Github
Program-Guided Image Manipulators	ICCV	2019	-
Neuro-Symbolic Visual Reasoning: Disentangling “Visual” from “Reasoning”	ICML	2020	Github
FALCON: Fast Visual Concept Learning by Integrating Images, Linguistic descriptions, and Conceptual Relations	ICLR	2022	-
A Neuro-Symbolic ASP Pipeline for Visual Question Answering	ICLP	2022	-
Chameleon: Plug-and-Play Compositional Reasoning with Large Language Models	NeurIPS	2023	Github
What's Left? Concept Grounding with Logic-Enhanced Foundation Models	NeurIPS	2023	Github
Visual Programming: Compositional visual reasoning without training	CVPR (Best Paper)	2023	Github
NS3D: Neuro-Symbolic Grounding of 3D Objects and Relations	CVPR	2023	Github
ViperGPT: Visual Inference via Python Execution for Reasoning	CVPR	2023	Github
Rapid Image Labeling via Neuro-Symbolic Learning	KDD	2023	Github
GENOME: Generative Neuro-Symbolic Visual Reasoning by Growing and Reusing Modules	ICLR	2024	-
Interpret Your Decision: Logical Reasoning Regularization for Generalization in Visual Classification	NeurIPS	2024	-
Integrating Neural-Symbolic Reasoning With Variational Causal Inference Network for Explanatory Visual Question Answering	TPAMI	2024	-
TV-TREES: Multimodal Entailment Trees for Neuro-Symbolic Video Reasoning	EMNLP	2024	-

Neuro-Symbolic Learning for Math Reasoning

Title	Venue	Date	Code
Solving Geometry Problems:Combining Text and Diagram Interpretation	ACL	2015	-
SMT-Solving Induction Proofs of Inequalities	Arxiv	2023	-
A Survey on Deep Learning for Theorem Proving	COLM	2024	-
A Symbolic Framework for Evaluating Mathematical Reasoning and Generalization with Transformers	ACL	2024	Github
AlphaIntegrator: Transformer Action Search for Symbolic Integration Proofs	Arxiv	2024	-
Proving Olympiad Algebraic Inequalities without Human Demonstrations	Arxiv	2024	-
Frugal LMs Trained to Invoke Symbolic Solvers Achieve Parameter-Efficient Arithmetic Reasoning	AAAI	2024	-
Neuro-Symbolic Data Generation for Math Reasoning	NeurIPS	2024	-
Autoformalize Mathematical Statements by Symbolic Equivalence and Semantic Consistency	NeurIPS	2024	Github
ToRA: A Tool-Integrated Reasoning Agent for Mathematical Problem Solving	ICLR	2024	Github
Don't Trust: Verify -- Grounding LLM Quantitative Reasoning with Autoformalization	ICLR	2024	Github
MathCoder: Seamless Code Integration in LLMs for Enhanced Mathematical Reasoning	ICLR	2024	Github
SubgoalXL: Subgoal-based Expert Learning for Theorem Proving	Arxiv	2024	-
Autoformalizing Euclidean Geometry	ICML	2024	Github
A Survey of Mathematical Reasoning in the Era of Multimodal Large Language Model: Benchmark, Method & Challenges	Arxiv	2024	-

Neuro-Symbolic Learning for Reinforcement Learning

Title	Venue	Date	Code
Modular multitask reinforcement learning with policy sketches	ICML	2017	-
Programmatically interpretable reinforcement learning	ICML	2018	-
SDRL: Interpretable and Data-efficient Deep Reinforcement Learning Leveraging Symbolic Planning	AAAI	2019	-
LTL and Beyond: Formal Languages for Reward Function Specification in Reinforcement Learning	IJCAI	2019	-
Distilling deep reinforcement learning policies in soft decision trees	IJCAI Workshop	2019	-
SDRL: Interpretable and Data-efficient Deep Reinforcement Learning Leveraging Symbolic Planning	AAAI	2019	-
Imitationprojected programmatic reinforcement learning	NeurIPS	2019	-
Language as an Abstraction for Hierarchical Deep Reinforcement Learning	NeurIPS	2019	-
Regression Planning Networks	NeurIPS	2019	-
PLANS: Neuro-Symbolic Program Learning from Videos	NeurIPS	2020
Synthesizing Programmatic Policies that Inductively Generalize	ICLR	2020
Neurosymbolic Reinforcement Learning with Formally Verified Exploration	NeurIPS	2020	-
Deepsynth: Program synthesis for automatic task segmentation in deep reinforcement learning	AAAI	2021	-
Neuro-Symbolic Reinforcement Learning with First-Order Logic	EMNLP	2021	-
Discovering symbolic policies with deep reinforcement learning	ICML	2021	-
Compositional Reinforcement Learning from Logical Specifications	NeurIPS	2021	-
Program Synthesis Guided Reinforcement Learning for Partially Observed Environments	NeurIPS	2021	-
Symbolic Visual Reinforcement Learning: A Scalable Framework with Object-Level Abstraction and Differentiable Expression Search	Arxiv	2022	-
Detect, Understand, Act: A Neuro-symbolic Hierarchical Reinforcement Learning Framework	Machine Learning	2022	-
Neurosymbolic Reinforcement Learning and Planning: A Survey	IEEE TAI	2023	-
Hierarchical Programmatic Reinforcement Learning via Learning to Compose Programs	ICML	2023	-
Robust Subtask Learning for Compositional Generalization	ICML	2023	-
Interpretable and Explainable Logical Policies via Neurally Guided Symbolic Abstraction	NeurIPS	2023	Github
Cosmos: Neurosymbolic Grounding for Compositional World Models	ICLR	2024	Github
Learning Concept-Based Causal Transition and Symbolic Reasoning for Visual Planning	ICLR	2024	Github
Skill Machines: Temporal Logic Skill Composition in Reinforcement Learning	ICLR	2024	Github
Enhancing Human-AI Collaboration Through Logic-Guided Reasoning	ICLR	2024	-
Neurosymbolic Grounding for Compositional World Models	ICLR	2024	Github
End-to-End Neuro-Symbolic Reinforcement Learning with Textual Explanations	ICML	2024	Github
Interpretable end-to-end Neurosymbolic Reinforcement Learning agents	Arxiv	2024	-
Temporal Logic Specification-Conditioned Decision Transformer for Offline Safe Reinforcement Learning	Arxiv	2024	-

Neuro-Symbolic Learning for Embodied AI

Title	Venue	Date	Code
Neural Task Programming: Learning to Generalize Across Hierarchical Tasks	ICRA	2018
Learning symbolic operators for task and motion planning	IROS	2021
PDSketch: Integrated Domain Programming, Learning, and Planning	NeurIPS	2022	Github
JARVIS: A Neuro-Symbolic Commonsense Reasoning Framework for Conversational Embodied Agents	Arxiv	2022	-
Mind's Eye: Grounded Language Model Reasoning through Simulation	Arxiv	2022	Github
Do As I Can, Not As I Say: Grounding Language in Robotic Affordances	Arxiv	2023	Github
Learning Neuro-Symbolic Skills for Bilevel Planning	COIL	2022	Github
ProgPrompt: Generating Situated Robot Task Plans using Large Language Models	ICRA	2023	Github
Learning Neuro-symbolic Programs for Language Guided Robot Manipulation	ICRA	2023
What's Left? Concept Grounding with Logic-Enhanced Foundation Models	NeurIPS	2023	Github
Programmatically Grounded, Compositionally Generalizable Robotic Manipulation	ICLR	2023	Github
Knowledge-based Embodied Question Answering	TPAMI	2023	-
Learning Adaptive Planning Representations with Natural Language Guidance	ICLR	2024	-
Learning Reusable Manipulation Strategies	CORL	2023	-
Code as Policies: Language Model Programs for Embodied Control	Arxiv	2023	Github
Compositional Diffusion-Based Continuous Constraint Solvers	CORL	2023	Github
Sequential Dexterity: Chaining Dexterous Policies for Long-Horizon Manipulation	CORL	2023
RoboCook: Long-Horizon Elasto-Plastic Object Manipulation with Diverse Tools	CORL	2023
Hierarchical Planning and Learning for Robots in Stochastic Settings Using Zero-Shot Option Invention	AAAI	2024	-
Learning Neuro-Symbolic Abstractions for Robot Planning and Learning	AAAI	2024	-
Grounding Language Plans in Demonstrations through Counter-factual Perturbations	ICLR	2024	Github
VisualPredicator: Learning Abstract World Models with Neuro-Symbolic Predicates for Robot Planning	Arxiv	2024	-
A Framework for Neurosymbolic Robot Action Planning using Large Language Models	Frontiers in Neurorobotics	2024	-
Fast and Accurate Task Planning using Neuro-Symbolic Language Models and Multi-level Goal Decomposition	Arxiv	2024	-
ClevrSkills: Compositional Language and Visual Reasoning in Robotics	NeurIPS Benchmark	2024	Github

Neuro-Symbolic Learning for Agent

Title	Venue	Date	Code
WebGPT: Browser-assisted question-answering with human feedback	Arxiv	2022	-
HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging Face	Arxiv	2023	-
ToolkenGPT: Augmenting Frozen Language Models with Massive Tools via Tool Embeddings	NeurIPS	2023	Github
TaskMatrix.AI: Completing Tasks by Connecting Foundation Models with Millions of APIs	Arxiv	2023	-
Symbolic Learning Enables Self-Evolving Agents	Arxiv	2024	Github

Neuro-Symbolic Learning for AIGC

Title	Venue	Date	Code
Neuro-Symbolic Generative Art: A Preliminary Study	Arxiv	2020	-
Generative Neurosymbolic Machines	NeurIPS	2020	-
SlotDiffusion: Object-Centric Generative Modeling with Diffusion Models	NeurIPS	2023	Github
Neuro-symbolic Empowered Denoising Diffusion Probabilistic Models for Real-time Anomaly Detection in Industry 4.0	Arxiv	2024	-

Misc

Title	Venue	Date	Code
Harnessing Deep Neural Networks with Logic Rules	ACL	2016	-
Neural-Symbolic Reasoning Under Open-World and Closed-World Assumptions	AAAI-MAKE	2022	-
Neuro-Symbolic Entropy Regularization	UAI	2022	Github
RuleMatch: Matching Abstract Rules for Semi-supervised Learning of Human Standard Intelligence Tests	IJCAI	2023	Github
Learning with Logical Constraints but without Shortcut Satisfaction	ICLR	2023	Github
The KANDY Benchmark: Incremental Neuro-Symbolic Learning and Reasoning with Kandinsky Patterns	Arxiv	2024	-
On the Hardness of Probabilistic Neurosymbolic Learning	ICML	2024	-
On the Independence Assumption in Neurosymbolic Learning	ICML	2024	-
Analysis for Abductive Learning and Neural-Symbolic Reasoning Shortcuts	ICML	2024	-
Convex and Bilevel Optimization for Neural-Symbolic Inference and Learning	ICML	2024	-
Bridging Neural and Symbolic Representations with Transitional Dictionary Learning	ICLR	2024	-
LogicMP: A Neuro-symbolic Approach for Encoding First-order Logic Constraints	ICLR	2024	-
Not All Neuro-Symbolic Concepts Are Created Equal: Analysis and Mitigation of Reasoning Shortcuts	NeurIPS	2023	-
Localized Symbolic Knowledge Distillation for Visual Commonsense Models	NeurIPS	2023	-
A-NeSI: A Scalable Approximate Method for Probabilistic Neurosymbolic Inference	NeurIPS	2023	-
Neuro-Symbolic Continual Learning:Knowledge, Reasoning Shortcuts and Concept Rehearsal	ICML	2023	Github
Out-of-Distribution Generalization by Neural-Symbolic Joint Training	AAAI	2023	Github

Awesome Datasets & Benchmarks

• Visual Sudoku: An visual sudoku puzzle
• CLEVR Dataset for VQA
• GQA Dataset for VQA
• LogiCity for Abstract Urban Simulation
• LogicGame Benchmarking Rule-Based Reasoning Abilities of Large Language Models
• Minigrid
• BabyAI
• Minecraft
• Mini-Behavior for Embodied Tasks
• CLIPort Dataset for Embodied Tasks
• ALFworld for Embodied Tasks
• VirtualHome for Embodied Tasks
• Planbench for evaluating LLM Planning
• RSbench A Neuro-Symbolic Benchmark Suite for Concept Quality and Reasoning Shortcuts

↑ Back to Top ↑