LLM+P

Large Language Models + Classical Planners

An LLM translates a natural-language planning problem into a formal PDDL problem file, and the Fast Downward classical planner computes a sound or minimum-cost plan.

Read the paper

The loop

  1. Proposes

    A PDDL problem specification (objects, initial state and goal predicates) translated from natural language by GPT-4

  2. Judged by

    The Fast Downward classical symbolic planner (classical planners LAMA and FDSS) running against the domain action schema

  3. Steers

    Fast Downward searches the symbolic state space to return a verified plan, which is translated back into natural language

Headline result

Across seven standard International Planning Competition (IPC) domains including Blocksworld, Barman, Floortile, Grippers, Storage, Termes and Tyreworld (20 tasks per domain), LLM+P with GPT-4 and in-context examples solved the majority of tasks with valid, cost-minimizing plans, whereas direct GPT-4 plan generation failed on almost all tasks in Barman, Floortile, Storage and Termes.

What this does not prove

LLM+P requires a human expert to supply the PDDL domain file (action preconditions and effects) in advance, and its one-shot translator has no validator-repair loop when the LLM emits syntax errors, undeclared objects or inverted goal predicates.

How it generalizes the harness

The LLM does not search for action sequences at all; it compiles natural language into PDDL so Fast Downward can perform sound symbolic search.

Classification

Classification of LLM+P (Large Language Models + Classical Planners)
What it proposesFormal specification
Generative modelGPT-4 (frozen) with in-context PDDL problem examples
Algorithmic authorityFast Downward classical symbolic planner
FeedbackTest results
What gets updatedPrompt context
When it runsAt inference time
ValidityFormal (machine-checked)
EvidenceExperiments reported
LineageOriginal system