# Constraint Decay: The Fragility of LLM Agents in Backend Code Generation

# Constraint Decay: The Fragility of LLM Agents in Backend Code Generation

**Authors:** Francesco Dente, Dario Satriani, Paolo Papotti
**Submitted:** May 7, 2026 (arXiv:2605.06445)
**Subjects:** Software Engineering (cs.SE); Artificial Intelligence (cs.AI)
**arXiv:** https://arxiv.org/abs/2605.06445

## Abstract

Large Language Model (LLM) agents demonstrate strong performance in autonomous code generation under loose specifications. However, production-grade software requires strict adherence to structural constraints, such as architectural patterns, databases, and object-relational mappings. The study evaluates agent performance across 80 greenfield and 20 feature-implementation tasks spanning eight web frameworks, finding that as structural requirements accumulate, agent performance exhibits a substantial decline — a phenomenon the authors call **constraint decay**.

## Main Result

Performance drops approximately 30 points in assertion pass rates when moving from baseline (loosely specified) to fully specified tasks, with some weaker configurations approaching zero performance. Simultaneously satisfying functional and structural requirements remains unresolved for coding agents.

## Key Claims

1. **Constraint decay** — as structural constraints accumulate, agent performance degrades sharply (~30-point drop in assertion pass rate from baseline to fully specified; weakest configs near zero).
2. **Framework sensitivity** — agents do significantly better with minimal frameworks (Flask) but struggle with convention-heavy environments (FastAPI, Django).
3. **Root cause: data-layer defects** — incorrect query composition and ORM runtime violations are the leading failure category.
4. Autonomous code generation under loose specifications does not transfer to production-grade backend work with strict architectural/database/ORM constraints.

## Benchmark Design

- 80 greenfield tasks + 20 feature-implementation tasks (100 total).
- Eight web frameworks evaluated (named examples: Flask, FastAPI, Django).
- Structural constraints tested: architectural patterns, databases, object-relational mappings (ORMs).
- Metric: assertion pass rate, measured from loosely specified baseline through fully specified tasks.