Skip to Content
SaaS tokenminningSelf-hosting Dagster

Self-hosting Dagster: benefits and break-even costs

Self-hosting Dagster OSS lets you keep using Dagster while removing the Dagster+ subscription and credit meter from your deployment. The economic benefit is strongest when many useful orchestration events fit within modest infrastructure capacity. Your team takes responsibility for keeping that deployment running.

Dagster publishes its open-source code under Apache 2.0  and documents OSS deployment . This is an established deployment path. It does not reproduce every managed-service feature or operating guarantee.

What you gain

Capacity you can reuse. On a fixed host, another run uses available CPU and memory rather than creating a Dagster+ credit charge. You can schedule more work within the paid-for capacity; scaling, storage growth, and downstream usage still cost money.

Freedom to retain useful asset boundaries. Fine-grained assets can make lineage and failures easier to understand. Removing the platform credit meter lets you evaluate that granularity on its engineering merits, while still measuring execution and metadata overhead.

Control over the deployment. You choose infrastructure, upgrade timing, retention, and network placement. This can be valuable when you already operate databases and container services and can reuse those skills.

A smaller application change than replacing the orchestrator. Evaluate hosting separately from rewriting pipelines in another framework. Cloud-specific configuration and deployment workflows still need replacing, but the starting point is your existing Dagster project.

For the billing mechanism that motivates this move, see why Dagster gets expensive.

Compare the operating arrangements

ArrangementWhat you pay forWhat your team operates
Dagster+ ServerlessPlatform plan, credits, and Serverless computePipeline code and downstream systems
Dagster+ HybridPlatform plan, credits, and your infrastructureExecution infrastructure and downstream systems
Self-hosted Dagster OSSInfrastructure, supporting services, and engineering timeControl plane, execution, persistence, and recovery

See the Dagster+ pricing terms  and Hybrid architecture . A small single-host OSS deployment should be compared with the availability it actually provides. Paying less for a system with a longer recovery time may be an acceptable choice, but record that choice.

Calculate how much operating time the saving buys

Use the same workload and billing period on both sides. Include host and worker compute, database storage, logs, backups, network transfer, monitoring, and attributable tool subscriptions. Costs and engineering work that remain unchanged cancel out of the comparison: exclude them from both sides or include them in both.

Count only operating hours added by self-hosting. Pipeline development and debugging already take time on the managed service. For Hybrid, include existing execution infrastructure in the managed baseline so it is not counted only as a new self-hosting expense.

Monthly self-hosting comparison cost = infrastructure and supporting services + incremental operating hours × internal hourly cost + migration cost / amortization months Monthly saving = avoidable managed-service and infrastructure cost - monthly self-hosting comparison cost

For a deliberately hypothetical example, assume a 2,000monthlymanaged−servicecost∗∗,∗∗2,000 monthly managed-service cost**, **400/month for self-hosted infrastructure and services, a 3,600migration∗∗spreadover12months,and∗∗3,600 migration** spread over 12 months, and **100/hour for incremental operations:

Budget remaining for operations = $2,000 - $400 - $300 = $1,300/month Break-even operating time = $1,300 / $100 = 13 hours/month

At four additional operating hours a month, that example has a comparison cost of 1,100/monthandsaves1,100/month and saves 900. At 13 hours, it breaks even. After the migration is fully amortized, the same inputs leave 16 operating hours before break-even. If infrastructure plus amortized migration already exceeds the avoidable managed cost, there is no positive operating-hours budget for savings.

These inputs are assumptions, not a host-sizing recommendation, supplier quote, or measured migration result. Replace them with your invoice, capacity measurements, and team’s costs. Check contract end dates and any period of overlapping deployments: an allocated monthly saving does not necessarily become an immediate cash saving.

The system you take ownership of

Dagster’s Docker Compose guide  describes separate webserver, daemon, and code-location services, typically with a container for each run. The daemon handles scheduled work and queued runs. A running UI alone does not prove the workload will execute.

Persistence needs its own design. Dagster’s instance configuration reference  separates metadata storage, compute logs, and local artifacts. Backing up the metadata database alone does not protect every output. Decide which files must survive worker removal and host loss, and test restoring them.

Before committing to the move, assign an operator and prove a representative workload on the proposed capacity:

  1. Execute normal runs and a representative backfill; measure memory, queue delay, and database load.
  2. Confirm worker access to secrets and downstream services, and verify logs remain readable after workers exit.
  3. Verify authenticated UI access and external monitoring that can detect a stopped daemon or unavailable host. A notification job cannot reliably report an outage of its own execution system.
  4. Exercise cancellation, a deployment while work is running, and restoration onto a replacement host. Record recovery time and the amount of data that could be lost between backups.
  5. Plan the scheduler handover and any missing data interval. Stop or account for old submissions before enabling new automation, and establish separately what history and automation state can be retained or transferred.

Use the official deployment guide as an implementation starting point, then validate it against your access controls and recovery requirements.

When the move is worth making

Self-hosting is a strong candidate when the platform bill is substantial, useful work fits within predictable capacity, and someone on the team can own operations. Its main benefit is changing what makes the bill grow: available resources and operating effort replace the managed event meter.

Keep managed hosting in the comparison when spend is low, recovery requirements are demanding, or operating the system would displace more valuable engineering work. The decision should preserve the parts of Dagster that help the team and remove costs that no longer justify their value.

Return to SaaS tokenminning for the section overview.

Last updated on