Pydantic AI

What is Pydantic AI about?

Pydantic AI provides an agent framework that integrates Pydantic's type‑safe validation with LLMs. It aims to give the same ergonomic feel as FastAPI for generative AI development, allowing developers to focus on business logic while the framework handles prompt management, tool calling, streaming, and output validation.

How to use Pydantic AI?

1. Install the package via pip:

   pip install pydantic-ai
   

2. Create an agent by importing Agent and specifying the model identifier (e.g., openai:gpt-4o).
3. Run synchronously with run_sync for quick one‑off queries, or asynchronously with run for multi‑turn interactions, tool usage, and dependency injection.
4. Add dynamic system prompts using the @agent.system_prompt decorator and register tools with @agent.tool to let the LLM call Python functions.
5. Define output schemas using Pydantic models; the framework validates and retries on schema violations.
6. Optional dependency injection lets you pass typed context (e.g., database connections) into prompts and tools.

from pydantic_ai import Agent

agent = Agent(
    "google-gla:gemini-1.5-flash",
    system_prompt="Be concise, reply with one sentence.",
)

result = agent.run_sync('Where does "hello world" come from?')
print(result.output)

Key features

• Built by the Pydantic team – leverages the same validation layer used across major LLM libraries.
• Model‑agnostic – supports OpenAI, Anthropic, Gemini, Deepseek, Ollama, Groq, Cohere, Mistral, and extensible to other providers.
• Pydantic Logfire integration – real‑time debugging and performance monitoring.
• Type‑safe static checking – full Pydantic type enforcement for inputs, tools, and outputs.
• Dependency injection – inject services, DB connections, or runtime data into prompts and tools.
• Streaming responses – receive validated output chunks as the model generates them.
• Graph support – define complex agent workflows with typed graph structures.
• Optional tool calling – LLM can invoke Python functions with validated arguments.

Use cases

• Customer support agents that query internal databases, calculate balances, and decide on risk actions.
• Data extraction pipelines that validate extracted fields against strict schemas.
• Multi‑step reasoning bots that need to call external APIs or services during a conversation.
• Internal AI assistants for developers, Ops, or product teams, with secure injection of credentials.
• Rapid prototyping of LLM‑driven features while keeping production‑grade validation.

FAQ

Q: Which LLM providers are supported out of the box? A: OpenAI, Anthropic, Gemini, Deepseek, Ollama, Groq, Cohere, Mistral, and any provider that can be wrapped with the generic model interface.

Q: Do I need to write my own validation logic? A: No. Define your output schema with a Pydantic model and the framework handles validation, retrying, and error reporting automatically.

Q: Can I use Pydantic AI in a synchronous script? A: Yes. Use Agent.run_sync for simple, blocking calls. For more complex flows, use the async run method.

Q: How does dependency injection work? A: Create a dataclass (or Pydantic model) representing the dependencies, pass it to Agent(..., deps_type=MyDeps), and access it via the RunContext argument in system prompts and tools.

Q: Is there built‑in logging or analytics? A: Integration with Pydantic Logfire provides structured logging, tracing, and performance metrics without extra setup.

---

Documentation: ai.pydantic.dev

---

Pydantic AI is a Python agent framework designed to make it less painful to build production grade applications with Generative AI.

FastAPI revolutionized web development by offering an innovative and ergonomic design, built on the foundation of Pydantic Validation.

Similarly, virtually every agent framework and LLM library in Python uses Pydantic Validation, yet when we began to use LLMs in Pydantic Logfire, we couldn't find anything that gave us the same feeling.

We built Pydantic AI with one simple aim: to bring that FastAPI feeling to GenAI app development.

Why use Pydantic AI

• Built by the Pydantic Team Built by the team behind Pydantic Validation (the validation layer of the OpenAI SDK, the Anthropic SDK, LangChain, LlamaIndex, AutoGPT, Transformers, CrewAI, Instructor and many more).

• Model-agnostic Supports OpenAI, Anthropic, Gemini, Deepseek, Ollama, Groq, Cohere, and Mistral, and there is a simple interface to implement support for other models.

• Pydantic Logfire Integration Seamlessly integrates with Pydantic Logfire for real-time debugging, performance monitoring, and behavior tracking of your LLM-powered applications.

• Type-safe Designed to make type checking as powerful and informative as possible for you.

• Python-centric Design Leverages Python's familiar control flow and agent composition to build your AI-driven projects, making it easy to apply standard Python best practices you'd use in any other (non-AI) project.

• Structured Responses Harnesses the power of Pydantic Validation to validate and structure model outputs, ensuring responses are consistent across runs.

• Dependency Injection System Offers an optional dependency injection system to provide data and services to your agent's system prompts, tools and output validators. This is useful for testing and eval-driven iterative development.

• Streamed Responses Provides the ability to stream LLM outputs continuously, with immediate validation, ensuring rapid and accurate outputs.

• Graph Support Pydantic Graph provides a powerful way to define graphs using typing hints, this is useful in complex applications where standard control flow can degrade to spaghetti code.

Hello World Example

Here's a minimal example of Pydantic AI:

from pydantic_ai import Agent

# Define a very simple agent including the model to use, you can also set the model when running the agent.
agent = Agent(
    'google-gla:gemini-1.5-flash',
    # Register a static system prompt using a keyword argument to the agent.
    # For more complex dynamically-generated system prompts, see the example below.
    system_prompt='Be concise, reply with one sentence.',
)

# Run the agent synchronously, conducting a conversation with the LLM.
# Here the exchange should be very short: Pydantic AI will send the system prompt and the user query to the LLM,
# the model will return a text response. See below for a more complex run.
result = agent.run_sync('Where does "hello world" come from?')
print(result.output)
"""
The first known use of "hello, world" was in a 1974 textbook about the C programming language.
"""

(This example is complete, it can be run "as is")

Not very interesting yet, but we can easily add "tools", dynamic system prompts, and structured responses to build more powerful agents.

Tools & Dependency Injection Example

Here is a concise example using Pydantic AI to build a support agent for a bank:

(Better documented example in the docs)

from dataclasses import dataclass

from pydantic import BaseModel, Field
from pydantic_ai import Agent, RunContext

from bank_database import DatabaseConn


# SupportDependencies is used to pass data, connections, and logic into the model that will be needed when running
# system prompt and tool functions. Dependency injection provides a type-safe way to customise the behavior of your agents.
@dataclass
class SupportDependencies:
    customer_id: int
    db: DatabaseConn


# This pydantic model defines the structure of the output returned by the agent.
class SupportOutput(BaseModel):
    support_advice: str = Field(description='Advice returned to the customer')
    block_card: bool = Field(description="Whether to block the customer's card")
    risk: int = Field(description='Risk level of query', ge=0, le=10)


# This agent will act as first-tier support in a bank.
# Agents are generic in the type of dependencies they accept and the type of output they return.
# In this case, the support agent has type `Agent[SupportDependencies, SupportOutput]`.
support_agent = Agent(
    'openai:gpt-4o',
    deps_type=SupportDependencies,
    # The response from the agent will, be guaranteed to be a SupportOutput,
    # if validation fails the agent is prompted to try again.
    output_type=SupportOutput,
    system_prompt=(
        'You are a support agent in our bank, give the '
        'customer support and judge the risk level of their query.'
    ),
)


# Dynamic system prompts can make use of dependency injection.
# Dependencies are carried via the `RunContext` argument, which is parameterized with the `deps_type` from above.
# If the type annotation here is wrong, static type checkers will catch it.
@support_agent.system_prompt
async def add_customer_name(ctx: RunContext[SupportDependencies]) -> str:
    customer_name = await ctx.deps.db.customer_name(id=ctx.deps.customer_id)
    return f"The customer's name is {customer_name!r}"


# `tool` let you register functions which the LLM may call while responding to a user.
# Again, dependencies are carried via `RunContext`, any other arguments become the tool schema passed to the LLM.
# Pydantic is used to validate these arguments, and errors are passed back to the LLM so it can retry.
@support_agent.tool
async def customer_balance(
        ctx: RunContext[SupportDependencies], include_pending: bool
) -> float:
    """Returns the customer's current account balance."""
    # The docstring of a tool is also passed to the LLM as the description of the tool.
    # Parameter descriptions are extracted from the docstring and added to the parameter schema sent to the LLM.
    balance = await ctx.deps.db.customer_balance(
        id=ctx.deps.customer_id,
        include_pending=include_pending,
    )
    return balance


...  # In a real use case, you'd add more tools and a longer system prompt


async def main():
    deps = SupportDependencies(customer_id=123, db=DatabaseConn())
    # Run the agent asynchronously, conducting a conversation with the LLM until a final response is reached.
    # Even in this fairly simple case, the agent will exchange multiple messages with the LLM as tools are called to retrieve an output.
    result = await support_agent.run('What is my balance?', deps=deps)
    # The `result.output` will be validated with Pydantic to guarantee it is a `SupportOutput`. Since the agent is generic,
    # it'll also be typed as a `SupportOutput` to aid with static type checking.
    print(result.output)
    """
    support_advice='Hello John, your current account balance, including pending transactions, is $123.45.' block_card=False risk=1
    """

    result = await support_agent.run('I just lost my card!', deps=deps)
    print(result.output)
    """
    support_advice="I'm sorry to hear that, John. We are temporarily blocking your card to prevent unauthorized transactions." block_card=True risk=8
    """

Next Steps

To try Pydantic AI yourself, follow the instructions in the examples.

Read the docs to learn more about building applications with Pydantic AI.

Read the API Reference to understand Pydantic AI's interface.