AI Dictionary of Terms

Spiralism (Model Collapse)

The degradation of AI model quality that occurs when models are trained on outputs from other AI models, creating a feedback loop where each generation loses fidelity, diversity, and accuracy — like a photocopy of a photocopy that becomes increasingly blurry and distorted.

The Simple Version

Imagine you have a beautiful photograph. You make a copy of it. The copy is pretty good, but if you look closely, it’s slightly less sharp. Now you copy the copy. And then copy that copy. After 10 generations, the image is blurry, distorted, and unrecognizable.

That’s spiralism (also called “model collapse”) in AI. When an AI model is trained on data that was generated by another AI, the new model learns not just the patterns in the original data, but also the errors, biases, and limitations of the generating model. Each generation compounds these issues.

After several generations, the AI’s outputs become repetitive, lose diversity, develop systematic errors, and drift further from reality. The “spiral” is the downward trajectory of quality as AI feeds on AI.

Detailed Explanation

Spiralism was formally documented in a 2023 Nature paper by Shumailov et al., which demonstrated that training models on AI-generated data leads to irreversible quality degradation.

The Mechanism:

  1. Generation 0: Model trained on human-created data (high quality, diverse)
  2. Generation 1: Model trained on Generation 0’s outputs (slightly degraded)
  3. Generation 2: Model trained on Generation 1’s outputs (more degraded)
  4. Generation N: Model outputs are repetitive, low-quality, and detached from reality

Why It Happens:

Mathematical Intuition: If a model has a 95% accuracy rate, training on its outputs means the next model learns from data that’s 5% wrong. If that model also has 95% accuracy, the next generation learns from data that’s ~10% wrong (5% from the first model’s errors, plus new errors). The errors compound exponentially.

Real-World Evidence:

Prevention Strategies:

Detection Methods:

Key Characteristics

Business Context

Spiralism poses existential risks to AI-dependent businesses:

Risks:

Mitigation Strategies:

Enterprise Examples:

Real-World Analogy

The game of “telephone” where a message is whispered from person to person. By the time it reaches the last person, the message is distorted, incomplete, and often unrecognizable from the original. Each person introduces small errors, and those errors compound. Spiralism is the AI equivalent — each generation of AI training on AI outputs distorts the “message” (the underlying patterns in the data).

Code Example

# Conceptual demonstration of spiralism
import numpy as np

# Simulate a simple generative model
def generate_data(true_distribution, noise_level=0.05):
    """Generate data from a distribution with some noise"""
    samples = np.random.choice(true_distribution, size=1000)
    # Add noise (simulating model imperfections)
    noisy_samples = samples + np.random.normal(0, noise_level, size=1000)
    return noisy_samples

# True underlying distribution (human-created data)
true_data = np.random.normal(0, 1, 10000)

# Simulate multiple generations of training on AI-generated data
generations = [true_data]
for gen in range(10):
    # Each generation is trained on the previous generation's outputs
    prev_gen = generations[-1]
    next_gen = generate_data(prev_gen, noise_level=0.05)
    generations.append(next_gen)

# Measure degradation
for i, gen_data in enumerate(generations):
    mean = np.mean(gen_data)
    std = np.std(gen_data)
    print(f"Generation {i}: mean={mean:.3f}, std={std:.3f}")

# Observation: As generations increase, the distribution
# becomes narrower (loss of diversity) and may drift from the true mean

Common Misconceptions

Sources & Further Reading