Chain-of-Experts

Multi-agent operations-research pipeline that translates natural-language optimization problems into LP/MIP code and repairs from program execution feedback.

Read the paper

The loop

  1. Proposes

    Specialized LLM roles extract mathematical terminology, formulate algebraic constraints, and emit Python PuLP/Gurobi solver code.

  2. Judged by

    The Python interpreter and MIP solver execute the generated formulation and report syntax errors, infeasibility, or optimal objective values.

  3. Steers

    A conductor chooses which role acts next; on a failed run the roles reflect on execution feedback in reverse order until one is at fault.

Headline result

Reported to significantly outperform state-of-the-art LLM-based approaches on the LPWP and ComplexOR operations research benchmarks.

What this does not prove

If the formulation specialist misinterprets an implicit constraint in the word problem without causing solver infeasibility, the MIP solver solves the wrong model.

How it generalizes the harness

An exact linear/integer programming solver computes the solution while program execution feedback drives reverse-order reflection by the roles.

Classification

Classification of Chain-of-Experts
What it proposesFormal specification
Generative modelGPT-4 multi-role formulation agents
Algorithmic authorityGurobi / PuLP mixed-integer programming solver
FeedbackVerifier errors
What gets updatedPrompt context
When it runsAt inference time
ValidityFormal (machine-checked)
EvidenceCode released
LineageOriginal system