Decision comparison
MLflow vs Weights & Biases vs Neptune.ai
MLflow and Weights & Biases are active products you can adopt today; Neptune.ai is not. Neptune.ai shut down its hosted service permanently on March 5, 2026, after its acquisition by OpenAI, and all external user data was deleted, so there is nothing left to export or migrate. Its descriptions on this page are historical context. The real choice is between the other two. MLflow is a prominent open-source AI engineering platform with 30M+ monthly downloads and zero licensing costs. W&B provides the most polished managed experience with best-in-class visualization and team collaboration features.
Neptune.ai is no longer available as an active product
Neptune.ai shut down its hosted service permanently on March 5, 2026 following its acquisition by OpenAI, and all external user data was deleted. There is nothing left to export or migrate. Treat this page as historical context rather than a current buying page.
Active alternatives to evaluate
Direct comparison. These are reviewed substitutes bought for the same job, so the differences below are the ones that decide between them.
All 3 are experiment tracking.
Quick Comparison
| Decision factor | MLflow | Weights & Biases | Neptune.ai |
|---|---|---|---|
| Best For | Teams wanting a fully open-source AI engineering platform with no vendor lock-in and 100+ framework integrations | ML teams seeking best-in-class experiment visualization, collaboration, and managed cloud infrastructure | No one today: Neptune.ai is discontinued. Until March 5, 2026, it served research teams training foundation models who needed to monitor and analyze months-long training runs. |
| Architecture | Open-source platform backed by Linux Foundation with observability, evaluation, prompt management, AI gateway, and agent server | Managed SaaS platform with experiment tracking, evaluations, tracing, scorers, and registry with lineage tracking | Was a specialized experiment tracker built for foundation model training, with support for multi-step and branching runs. The hosted service no longer runs. |
| Pricing Model | Open-source license (Apache-2.0), self-hosted for free | Weights & Biases is now part of CoreWeave Forge, whose pricing page lists the plans. Free: $0 per month, up to 5 model seats, 5 GB of storage and 1 GB of Weave data ingestion a month. Pro: starts at $60 per month, billed monthly, for early-stage teams with fewer than 50 employees; up to 10 model seats, 100 GB of storage and 1.5 GB of Weave data ingestion a month; additional storage $0.03 per GB and additional Weave data ingestion $0.10 per MB. Enterprise: custom plans with customizable seats, storage and ingestion; additional Weave data ingestion $0.20 per MB. Academic: free, with unlimited projects and teams and 200 GB of cloud storage. Verified 2026-10-09 against https://coreweave.com/forge-pricing. | No longer sold. Neptune.ai shut down its hosted service permanently on March 5, 2026, after its acquisition by OpenAI, and all external user data was deleted. There is no current plan or price to buy, and its former enterprise plans are not a purchasing option. |
| Ease of Use | Three-step setup from zero to full-stack LLMOps in minutes with autolog capabilities and minimal code changes | Polished cloud UI with built-in dashboards for debugging, comparing, and reproducing models across teams | Historically offered a purpose-built UI for filtering and searching through large volumes of experiment data and for visualizing thousands of metrics; that UI went offline with the shutdown. |
| Scalability | Battle-tested at scale by Fortune 500 companies with 30M+ monthly package downloads | Cloud-hosted infrastructure with single tenant enterprise option and flexible deployment across regions | Was designed to handle large volumes of experiment data from long-running foundation model training. None of that capacity is available since the March 2026 shutdown. |
| Community/Support | 27,000+ GitHub stars, 900+ contributors, backed by Linux Foundation with active community support | 11,000+ GitHub stars, MIT license, priority email and chat support on Pro, enterprise support packages available | No support or service: OpenAI acquired Neptune and the hosted service closed for good on March 5, 2026. Before that, Neptune.ai ran an enterprise-focused support model. |
MLflow
- Best For:
- Teams wanting a fully open-source AI engineering platform with no vendor lock-in and 100+ framework integrations
- Architecture:
- Open-source platform backed by Linux Foundation with observability, evaluation, prompt management, AI gateway, and agent server
- Pricing Model:
- Open-source license (Apache-2.0), self-hosted for free
- Ease of Use:
- Three-step setup from zero to full-stack LLMOps in minutes with autolog capabilities and minimal code changes
- Scalability:
- Battle-tested at scale by Fortune 500 companies with 30M+ monthly package downloads
- Community/Support:
- 27,000+ GitHub stars, 900+ contributors, backed by Linux Foundation with active community support
Weights & Biases
- Best For:
- ML teams seeking best-in-class experiment visualization, collaboration, and managed cloud infrastructure
- Architecture:
- Managed SaaS platform with experiment tracking, evaluations, tracing, scorers, and registry with lineage tracking
- Pricing Model:
- Weights & Biases is now part of CoreWeave Forge, whose pricing page lists the plans. Free: $0 per month, up to 5 model seats, 5 GB of storage and 1 GB of Weave data ingestion a month. Pro: starts at $60 per month, billed monthly, for early-stage teams with fewer than 50 employees; up to 10 model seats, 100 GB of storage and 1.5 GB of Weave data ingestion a month; additional storage $0.03 per GB and additional Weave data ingestion $0.10 per MB. Enterprise: custom plans with customizable seats, storage and ingestion; additional Weave data ingestion $0.20 per MB. Academic: free, with unlimited projects and teams and 200 GB of cloud storage. Verified 2026-10-09 against https://coreweave.com/forge-pricing.
- Ease of Use:
- Polished cloud UI with built-in dashboards for debugging, comparing, and reproducing models across teams
- Scalability:
- Cloud-hosted infrastructure with single tenant enterprise option and flexible deployment across regions
- Community/Support:
- 11,000+ GitHub stars, MIT license, priority email and chat support on Pro, enterprise support packages available
Neptune.ai
- Best For:
- No one today: Neptune.ai is discontinued. Until March 5, 2026, it served research teams training foundation models who needed to monitor and analyze months-long training runs.
- Architecture:
- Was a specialized experiment tracker built for foundation model training, with support for multi-step and branching runs. The hosted service no longer runs.
- Pricing Model:
- No longer sold. Neptune.ai shut down its hosted service permanently on March 5, 2026, after its acquisition by OpenAI, and all external user data was deleted. There is no current plan or price to buy, and its former enterprise plans are not a purchasing option.
- Ease of Use:
- Historically offered a purpose-built UI for filtering and searching through large volumes of experiment data and for visualizing thousands of metrics; that UI went offline with the shutdown.
- Scalability:
- Was designed to handle large volumes of experiment data from long-running foundation model training. None of that capacity is available since the March 2026 shutdown.
- Community/Support:
- No support or service: OpenAI acquired Neptune and the hosted service closed for good on March 5, 2026. Before that, Neptune.ai ran an enterprise-focused support model.
Public signals
Verified factual signals only. Bars appear only for like-for-like metrics with five weekly assessments for every tool; missing evidence stays explicit. These signals do not establish enterprise adoption, product quality, or total cost.
| Metric | MLflow | Weights & Biases | Neptune.ai |
|---|---|---|---|
| GitHub commits, 90d(Product adoption) | 1.5k | 478 | Not available |
| GitHub stars(Product adoption) | 28,000+ | 11,000+ | Not available |
| Search interest(Market interest) | 2 | 0 | 0 |
| Hacker News mentions, 90d(Community interest) | 4 | 0 | Not available |
| PyPI weekly downloads(Product adoption) | 5.4M | 4.6M | Not available |
| Stack Overflow questions(Community interest) | 771 | 139 | 20 |
| Docker Hub pulls(Product adoption) | Not available | 4.1M | Not available |
| Hugging Face downloads(Product adoption) | Not available | 3.3k | Not available |
| Hugging Face likes(Product adoption) | Not available | 34 | Not available |
| npm weekly downloads(Developer adoption) | Not available | 5.1k | Not available |
| Product Hunt comments(Community interest) | Not available | 8 | 0 |
| Product Hunt rating(Community interest) | Not available | 5.0/5 | Unavailable |
| Product Hunt reviews(Community interest) | Not available | 3 | 0 |
| Product Hunt votes(Community interest) | Not available | 110 | 6 |
| GitHub commits, 90d(Developer adoption) | Not available | Not available | 0 |
| GitHub stars(Developer adoption) | Not available | Not available | 16 |
| PyPI weekly downloads(Developer adoption) | Not available | Not available | 22.5k |
As of November 16, 2026 — updated weekly.
Health & risk evidence
Observed public-source checks for mapped package versions and repositories.
MLflow
November 16, 2026Package vulnerabilities
PyPI · mlflow@3.18.0
0 vulnerabilities
across 1 package
Repository security score
github.com/mlflow/mlflow
5.0/10
Weights & Biases
November 16, 2026Package vulnerabilities
npm · @wandb/sdk@0.5.1 · PyPI · wandb@0.31.0
0 vulnerabilities
across 2 packages
Repository security score
Not available
Neptune.ai
November 9, 2026Package vulnerabilities
PyPI · neptune@1.14.0.post2
0 vulnerabilities
across 1 package
Repository security score
Not available
Interface Preview
MLflow

Weights & Biases

Neptune.ai

Feature Comparison
| Feature | MLflow | Weights & Biases | Neptune.ai |
|---|---|---|---|
| Experiment Tracking & Logging | |||
| Experiment Tracking | Full experiment tracking with parameters, metrics, and artifacts logging across ML and LLM workflows | Comprehensive experiment tracking for architecture, hyperparameters, git commits, model weights, GPU usage, and predictions | Was a specialized tracker for foundation model training with multi-step and branching runs; discontinued on March 5, 2026 |
| Metrics Visualization | Built-in MLflow UI for exploring traces, metrics, and parameters with comparison views | Best-in-class visualization dashboards for debugging, comparing, and reproducing model experiments | Visualized and compared thousands of metrics in seconds with fast filtering and search (historical; the service is shut down) |
| Artifact Management | Log and retrieve artifacts including models, datasets, and files with full lineage tracking | AI assets registry with lineage tracking for models, datasets, and experiment artifacts | Tracked large amounts of experiment data for long training runs; all external user data was deleted at the shutdown |
| LLM & Agent Support | |||
| LLM Observability | Complete trace capture for LLM applications and agents built on OpenTelemetry with production monitoring | AI application tracing and scorers for evaluating LLM application performance and behavior | Not offered; it focused on training-time monitoring before it shut down |
| Prompt Management | Version, test, and deploy prompts with full lineage tracking and automatic optimization algorithms | AI application evaluations and scorers for assessing prompt and model output quality | Had no dedicated prompt management features; it focused on experiment tracking for model training |
| Agent Deployment | Agent Server with FastAPI-based hosting, automatic request validation, streaming, and built-in tracing | No dedicated agent deployment server; focuses on experiment tracking and model management | Had no agent deployment capabilities; the product is discontinued |
| Integrations & Ecosystem | |||
| Framework Support | Works with 100+ AI frameworks including LangChain, OpenAI, PyTorch, and supports Python, TypeScript, Java, R | Integrates with PyTorch, TensorFlow, Keras, JAX, and major deep learning and reinforcement learning frameworks | Worked with major ML frameworks for experiment tracking during model training (historical) |
| API Gateway | Unified AI Gateway for all LLM providers with request routing, rate limits, fallbacks, and cost control | CI/CD automations with Slack and email alerts for pipeline integration and notifications | Had no API gateway; it covered experiment tracking and training monitoring only |
| Open Source Ecosystem | 27,000+ GitHub stars, 900+ contributors, Apache 2.0 license, backed by Linux Foundation | 11,000+ GitHub stars, MIT license client library with managed SaaS platform | Acquired by OpenAI; the hosted service shut down permanently on March 5, 2026 |
| Security & Deployment | |||
| Deployment Options | Self-hosted on any cloud or on-premise with Docker support; no vendor lock-in across infrastructure | Multi-cloud SaaS, self-hosted with Docker, single tenant enterprise option with choice of region | None: the hosted service is closed and cannot be deployed or used today |
| Security & Compliance | Self-hosted model gives full control over data security; no data leaves your infrastructure | HIPAA compliant option, SSO, SCIM provisioning, customer-managed encryption keys, audit logs, custom roles | Not applicable: the service is shut down and all external user data was deleted |
| Access Controls | Configurable access through self-hosted infrastructure; no built-in multi-tenant access controls | Team-based access controls, custom roles, service accounts, and automated user provisioning via SCIM | Not available: there are no Neptune.ai accounts or workspaces to manage since March 5, 2026 |
| Evaluation & Quality | |||
| Model Evaluation | 50+ built-in metrics and LLM judges with flexible APIs for custom evaluations and regression detection | AI application evaluations with built-in scorers for assessing model and application quality | Compared training runs with metric analysis to judge training progress (historical) |
| Hyperparameter Tuning | Experiment tracking for hyperparameter search with comparison and optimization support | Built-in hyperparameter sweep functionality with Bayesian optimization and grid search strategies | Tracked and compared hyperparameter configurations across thousands of training experiments (historical) |
| Production Monitoring | Monitor production quality, costs, and safety for deployed AI applications and agents | Track deployed model performance with alerting via Slack and email integrations | Monitored months-long foundation model training with step and branch tracking until the March 2026 shutdown |
Experiment Tracking & Logging
Experiment Tracking
Metrics Visualization
Artifact Management
LLM & Agent Support
LLM Observability
Prompt Management
Agent Deployment
Integrations & Ecosystem
Framework Support
API Gateway
Open Source Ecosystem
Security & Deployment
Deployment Options
Security & Compliance
Access Controls
Evaluation & Quality
Model Evaluation
Hyperparameter Tuning
Production Monitoring
Which to choose
MLflow and Weights & Biases are active products you can adopt today; Neptune.ai is not. Neptune.ai shut down its hosted service permanently on March 5, 2026, after its acquisition by OpenAI, and all external user data was deleted, so there is nothing left to export or migrate. Its descriptions on this page are historical context. The real choice is between the other two. MLflow is a prominent open-source AI engineering platform with 30M+ monthly downloads and zero licensing costs. W&B provides the most polished managed experience with best-in-class visualization and team collaboration features.
Best-fit scenarios
Choose MLflow if:
Teams wanting a free, open-source AI engineering platform with full LLM and agent lifecycle support and no vendor lock-in
Choose Weights & Biases if:
ML teams needing a managed cloud platform with best-in-class visualization, collaboration features, and enterprise security
Neptune.ai (no longer available):
Neptune.ai cannot be chosen today. Its hosted service shut down permanently on March 5, 2026, after OpenAI acquired Neptune, and all external user data was deleted, so there is no plan to buy and no account to keep using. Neptune.ai was an experiment tracker for training foundation models: it monitored months-long training runs with multiple steps and branches and compared thousands of metrics in seconds. For that need, MLflow is the compared tool to choose instead: open-source ML lifecycle management that logs parameters, metrics and artifacts across ML and LLM workflows, self-hosted under Apache 2.0 with no licensing cost. Teams that want a managed service rather than running their own tracking server should pick Weights & Biases, which tracks architecture, hyperparameters, git commits, model weights, GPU usage, datasets and predictions, with a Free tier for up to 5 seats.
These scenarios reflect the available product evidence. Your requirements, existing stack, and team expertise should guide the final decision.
Frequently Asked Questions
What is the main difference between MLflow, W&B, and Neptune.ai?
MLflow is a fully open-source AI engineering platform backed by the Linux Foundation that covers the entire ML lifecycle from experiment tracking to agent deployment, all at zero licensing cost. Weights & Biases is a managed SaaS platform that provides best-in-class experiment visualization and team collaboration with Pro pricing starting at $60/month, billed monthly. Neptune.ai was a specialized experiment tracker for foundation model training, built for months-long training runs and massive experiment data, but it is no longer a product you can use: OpenAI acquired Neptune and the hosted service closed for good on March 5, 2026. The live difference is between the other two: MLflow provides the broadest feature set including LLM observability, prompt management, and an agent server, while W&B focuses on polished visualization and team workflows.
Is MLflow really free to use compared to W&B and Neptune.ai?
MLflow is 100% free and open source under the Apache 2.0 license with no usage limits, seat restrictions, or premium tiers. You self-host it on your own infrastructure, which means you bear the infrastructure costs but pay nothing for the software itself. Weights & Biases offers a Free tier with 5 seats and 5 GB/month storage, but advanced features like team collaboration, access controls, and enterprise security require the Pro plan, which starts at $60/month, billed monthly, or custom Enterprise pricing. Neptune.ai has no price to compare: it is no longer sold, because its hosted service shut down permanently on March 5, 2026, after the OpenAI acquisition, and every external user's data was deleted. For teams with the infrastructure expertise to self-host, MLflow provides the most cost-effective path, while W&B's managed service reduces operational overhead.
Which platform has the best experiment tracking and visualization?
Weights & Biases is widely recognized for having the most polished experiment tracking and visualization experience among the three platforms. W&B lets teams track and compare architecture, hyperparameters, git commits, model weights, GPU usage, datasets, and predictions in interactive dashboards purpose-built for ML workflows. Neptune.ai was known for visualizing thousands of metrics in seconds from large-scale foundation model training, with filtering and search built for massive experiment data, but that service went offline on March 5, 2026 and cannot be adopted. MLflow provides solid experiment tracking through its built-in UI with trace exploration, metric comparison, and parameter analysis, plus 50+ built-in evaluation metrics and LLM judges. Between the two tools you can still adopt, pick W&B for general ML team collaboration and MLflow for open-source flexibility with integrated LLM observability.
How do these tools compare for LLM and agent development?
MLflow has the most comprehensive LLM and agent support among the three tools. It provides production-grade observability built on OpenTelemetry for tracing LLM applications and agents, prompt versioning and automatic optimization, an AI Gateway for managing multiple LLM providers with rate limiting and cost control, and an Agent Server for deploying agents to production with a single command. Weights & Biases has added AI application evaluations, tracing, and scorers for LLM workflows, but does not offer a dedicated agent deployment server or API gateway. Neptune.ai focused on model training experiments rather than LLM application development or deployment, and it has been discontinued since March 2026. For teams building production AI applications with agents and LLM integrations, MLflow provides the most complete platform, while W&B serves well for teams that need managed experiment tracking alongside their LLM development workflow.
Is Neptune.ai still available, and what happened to its data?
No. Neptune.ai shut down its hosted service permanently on March 5, 2026, following its acquisition by OpenAI. All external user data was deleted, so former users have nothing left to export or migrate, and new users cannot sign up. Of the tools on this page, MLflow covers the experiment tracking Neptune.ai offered, as open-source ML lifecycle management you run on your own infrastructure; Weights & Biases covers the same need as a managed service.