300+ Tools CoveredSource Data Updated Weeklydates

Tool intelligence profile

Arize Phoenix

LLM tracing and evaluation built on OpenTelemetry — run it in a notebook, a container or the free Phoenix Cloud tier, and keep the same spans when you move to Arize's commercial platform. Source-available under the Elastic Licence 2.0, not OSI open source.

Visit Site →
Type
LLM Observability & Evaluation
Pricing
Free tier
Deployment
Cloud or self-hosted
Best for
AI engineers who want tracing running in one command
Last updatedSeptember 20, 2026

Editor's Take

Best for AI engineers who want a trace in front of them immediately — one command to a running instance, OpenTelemetry-based so spans stay portable, and free everywhere including the hosted Phoenix Cloud tier. The trade-off is the licence: the repository is Elastic Licence 2.0, which is source-available rather than OSI open source, so it is disqualified from any stack with an open-source-only requirement however the vendor describes it. Not a fit when you need prompt deployment and rollback as a first-class workflow, where Langfuse is built around it, or when you want a supported production platform — that is Arize AX, a separate purchase.

— Egor Burlakov, Editor

Evaluate Arize Phoenix

Comparisons

Arize Phoenix: product and architecture

This Arize Phoenix review covers the LLM tracing and evaluation tool you can have running before you finish reading this sentence — uvx arize-phoenix serve is the whole installation — and one licence detail that decides whether it belongs in your stack at all. Phoenix is free, it is built on OpenTelemetry, and it is source-available under the Elastic Licence 2.0 rather than OSI open source. We evaluated it against its documentation, its GitHub repository, and the adoption signals we collect weekly.

Overview

Phoenix is published by Arize AI and is the open, local-first companion to Arize AX, the vendor's commercial observability platform. Our 14 September 2026 snapshot recorded about 11,500 GitHub stars, roughly 160,000 PyPI downloads a week for arize-phoenix, and about 5.6 million pulls of the arizephoenix/phoenix container image. The release cadence is brisk: arize-phoenix-v20.14.0 shipped on 18 September 2026.

Its market position is the fastest path from nothing to a first trace. The design intent is local-first — run it in a notebook, in a container, or as Phoenix Cloud — which makes it the tool people reach for while developing rather than after deploying.

The licence is the thing to settle before anything else. The project's own site says "ELv2 licensed", and the repository LICENSE is Elastic License 2.0. That is source-available: you can read it, run it, and modify it, but it is not an OSI-approved open-source licence, and a stack with an open-source-only requirement cannot include it however the marketing reads.

The audience is AI engineers who want to see what their agent did, now, without provisioning anything.

Key Features and Architecture

Phoenix organises around a five-step loop the documentation states explicitly: observe, annotate, hypothesise, experiment, measure. That is unusually honest product design — it names the workflow rather than listing features — and it is a good description of what debugging an agent actually involves.

Tracing captures every step: prompts, retrievals, tool calls, outputs. Instrumentation is OpenTelemetry-based through OpenInference, which means an application already emitting OTel spans needs no bespoke integration, and spans you send to Phoenix during development can go to a different backend in production without re-instrumenting.

Annotations let a human mark what worked and what broke, or an LLM judge do it at scale. This is the step most tools skip, and it is the one that converts a pile of traces into labelled data.

Datasets and experiments turn traces into test cases. A failure becomes a dataset row, a hypothesis becomes an experiment, and the experiment measures whether the change helped.

The Prompt IDE iterates prompts against those datasets rather than against a blank box.

Two newer capabilities are worth noting. Talk with your traces is a conversational interface over the trace data for investigation, annotation, and running experiments. Agent-native integration installs Phoenix as a skill for coding agents via npx skills add Arize-ai/phoenix, so an agent can instrument and query your traces.

Deployment covers local, self-hosted container, and Phoenix Cloud. The upgrade path is Arize AX, which shares the span format, so moving does not mean re-instrumenting.

Ideal Use Cases

Four situations favour Phoenix. The first is development-time debugging. A single command and you can see what your agent did, which is a materially different proposition from provisioning a platform and wiring an SDK, and it is why Phoenix often ends up in a repo before anyone decides on production observability.

The second is an OpenTelemetry estate. If your services already emit OTel, Phoenix is a destination rather than an integration project, and the spans remain portable.

The third is notebook-based evaluation work. Running the tool in the same notebook as the experiment removes the context switch, and for data scientists iterating on prompts that is the whole workflow.

The fourth is a team already on Arize AX, or expecting to be. Shared span format means development and production are the same data, which is not true when you pair an unrelated dev tool with a production platform.

Do not choose Phoenix if a licence requirement covers this layer. The Elastic Licence 2.0 is source-available, not open source, and no amount of "OSS Community" language changes what an automated licence check will conclude — Langfuse's MIT core or Helicone's Apache 2.0 are the alternatives that pass. It is also the wrong pick if you want a single vendor-supported production platform with a support contract, which is what Arize AX is sold as. And prompt management with deployment and rollback is not the focus here the way it is in Langfuse.

Pricing and Licensing

Phoenix costs nothing. The server is free to run yourself, whether locally, in a container, or self-hosted for a team, and the hosted Phoenix Cloud tier is also free. There is no paid Phoenix tier, no seat charge, and no feature held back for a commercial edition of Phoenix itself.

The commercial product is Arize AX, and it is a separate purchase rather than a Phoenix upgrade. AX Free covers 25,000 spans a month, AX Pro is $50 per month with 50,000 spans, and AX Enterprise is quoted with custom volumes and a self-hosted option. Those numbers describe AX, not Phoenix, and conflating them is the easiest mistake to make when budgeting.

The licence is the cost that is not measured in money. Elastic Licence 2.0 permits use and modification but restricts providing the software as a managed service to third parties, and it is not OSI-approved. For most teams running it internally that restriction never binds. For a team with a contractual or policy requirement that every component be open source, it is disqualifying, and the honest reading is that Phoenix is free but not open.

Compared with the alternatives: Langfuse's server is also free to self-host with an MIT core; Helicone is Apache 2.0 with a free tier; Braintrust is proprietary with a free Starter plan. Phoenix's distinction is that it is the cheapest to try and the least encumbered operationally, at the cost of the licence property.

Strengths & Trade-offs

Pros

  • One command to a running instance, which makes it the lowest-friction way to see what an agent actually did.
  • OpenTelemetry-based through OpenInference, so spans are portable and existing instrumentation works.
  • Free everywhere — local, self-hosted, and the hosted Phoenix Cloud tier — with no paid Phoenix edition.
  • A named workflow, observe to measure, rather than a feature list, and annotations are a first-class step rather than an afterthought.
  • A shared span format with Arize AX, so moving to the commercial platform is not a re-instrumentation project.

Cons

  • Elastic Licence 2.0 is source-available, not OSI open source, so it fails an open-source-only requirement despite the community framing.
  • The free product is the on-ramp to a paid platform, and the roadmap incentive points toward AX over time.
  • Prompt management with deployment and rollback is thinner than in tools built around it.
  • Self-hosting at team scale is a service and a datastore to operate, which the one-command local experience understates.
  • AX pricing is easy to mistake for Phoenix pricing, and the two are different products.

Alternatives to Arize Phoenix

The reviewed substitutes for Arize Phoenix among the LLM observability & evaluation, and what would make each one the better answer.

Direct alternatives

Reviewed substitutes: products bought for the same job, where a team picks one.

Braintrust
Both score LLM output against datasets and record production traces. They are alternatives for the same evaluation workflow.
Helicone
Both are open LLM observability tools a team runs itself. Helicone integrates as a proxy and Phoenix through OpenTelemetry, but the purchase decision is one or the other.
Langfuse
Both are LLM tracing and evaluation platforms built on OpenTelemetry and run by the team itself. A team picks one as its trace destination.
Explore all Arize Phoenix alternatives →

Public signals

About these signals

Verified factual signals from public sources. They indicate observable activity or interest, not total adoption, product quality, or cost.

1.2k GitHub commits 90d11.6k GitHub stars0 vulnerabilities across 2 packages

See all signals from 5 sources
Source
Signals
Last updated
GitHub
Commits 90d:1.2kStars:11.6k
September 21, 2026
Docker Hub
Pulls:5.6M
September 21, 2026
PyPI
Weekly downloads:155.0k
September 21, 2026
npm
Weekly downloads:62.7k
September 21, 2026
OSV
Package vulnerabilities:0 vulnerabilitiesacross 2 packages

npm · @arizeai/phoenix-client@7.11.0 · PyPI · arize-phoenix@20.14.0

September 21, 2026

Frequently asked questions

Is Arize Phoenix open source?

No, not in the OSI sense. The repository LICENSE is Elastic License 2.0, which is source-available: you can read, run and modify it, but it restricts offering the software as a managed service and it is not OSI-approved. A stack with an open-source-only requirement cannot include it.

What does Phoenix cost?

Nothing. The server is free to run locally, in a container or self-hosted, and the hosted Phoenix Cloud tier is free. The paid product is Arize AX, a separate platform: AX Free covers 25,000 spans a month, AX Pro is $50 per month with 50,000 spans, and AX Enterprise is quoted.

How do I run Phoenix?

The documented quickstart is a single command, uvx arize-phoenix serve. It also runs in a notebook, as a self-hosted container, or as Phoenix Cloud.

Phoenix or Langfuse?

Choose Phoenix for the quickest path to a first trace and for a team already emitting OpenTelemetry. Choose Langfuse when the licence has to be OSI open source, or when prompt management with deployment and rollback matters as much as tracing.

Related LLM Observability & Evaluation

Other LLM observability & evaluation in the catalog. Same kind of product, not a substitution recommendation.