Databricks charges $7 per H100 GPU-hour, 2.4 times the market rate, and caps a node at eight GPUs

AI Runtime, Databricks' serverless GPU service, went generally available on October 21 at $7.00 per H100-hour, about 2.4 times the market rental rate. The docs cap a node at eight GPUs and warn regional capacity can run out.

Vincent JiangVincent Jiang · 3 min read
Share
Ali Ghodsi, Databricks' chief executive and co-founder
1 / 5Slide 1 of 5
Ali Ghodsi, Databricks' chief executive and co-founder

Databricks$216.58B — Databricks, private, latest valuation $216.58B, the private data-platform company valued at $190 billion by its August investors 1, moved AI Runtime to general availability on October 21, 2026 2. The service rents serverless NVIDIA+2.27% — NVIDIA, up 2.27 percent today GPUs for fine-tuning open models inside the lakehouse, the governed store where its enterprise customers already keep their data, with NVIDIA's NeMo containers and the new Nemotron 3.5 models available from day one 3. The Inference tracked Databricks' paper here on October 2; the new fact this week is the service's first public unit price, and the fine print under it 3.

The showcase ran 16 GPUs. The docs cap a node at eight

The showcase customer made the pitch. Kostia Omelianchuk, an applied research scientist at the email app maker Superhuman, moved a training run from one node of eight A100 GPUs to 16 H100s; training time fell from about seven days to 48 hours, a 3.5-times speedup 2. The quote does not separate the newer chip's gain from the second node's 4, and the second node is the product's open seam. Databricks' documentation, updated October 20, the day before launch, says all AI Runtime accelerators provision a single node, capped at eight GPUs 4.

Seven dollars an hour, on hardware Databricks does not own

List price on AWS+0.34% — AWS, up 0.34 percent today, Premium plan, US East: $7.00 per H100 GPU-hour and $2.50 per A10, both still tagged Preview after general availability 4. At list, Superhuman's run is 768 GPU-hours, about $5,376, with two nodes billing $112 an hour 4. The open market rents the same chip for less: Silicon Data's standardized index of specialized GPU clouds read $2.89 per H100-hour on October 25 5. Databricks' list price is about 2.4 times what the open market charges for identical silicon, and 52 cents below the market rate for NVIDIA's newer B300, $7.52 5.

Databricks' $7 H100-hour sits above the open market for the same chip

$0 / GPU-hour$2 / GPU-hour$4 / GPU-hour$6 / GPU-hour$8 / GPU-hourB300, market index$7.52 / GPU-hourH100 on AIR, list$7 / GPU-hourList price, still tagged PreviewH200, market index$3.47 / GPU-hourH100, market index$2.89 / GPU-hour
Data
Value
B300, market index$7.52 / GPU-hour
H100 on AIR, list$7 / GPU-hour
H200, market index$3.47 / GPU-hour
H100, market index$2.89 / GPU-hour
Databricks AI Runtime list price (AWS, Premium plan, US East, tagged Preview) against Silicon Data standardized market rental indices; US dollars per GPU-hour, October 25, 2026.4,5

The docs, not the blog, describe the product

The launch post says workloads "scale to hundreds of GPUs reliably", backed by 100,000-plus GPU-hour runs at hundreds of customers including Robinhood−2.29% — Robinhood, down 2.29 percent today, Merck and FactSet−3.03% — FactSet, down 3.03 percent today 2. The hardware table has no row beyond eight GPUs 4. The docs warn capacity "may be constrained or unavailable in your region", say high-demand runs can land in other regions at data-transfer cost, and allow 14-day CLI jobs whose restart needs hardware again 4.

Databricks does not own the silicon: its chief executive said in August it carries multibillion-dollar cloud commitments with AWS, Microsoft+1.10% — Microsoft, up 1.10 percent today and Google 1. Rental rates are already moving, with the H100 index up 6.2 percent in a week and the B300 up 10.6 percent 5. If wholesale hardens, Databricks absorbs the spread, re-tags the price, or declines supply under the footnote that displayed pricing "does not guarantee product availability" 4.

Tubi is happy. The analysts are split

The counterweight is real usage. Tubi's principal machine-learning scientist is "very happy with the compute availability" 2. Analysts credit AIR's integration with Unity Catalog, Databricks' permissions layer, as the actual differentiator, while flagging that available GPU capacity is the open question given limited supply, and that most enterprises may never need training compute at this scale 6.

Watch the Preview tag

Two signals say whether the $7 anchor holds: whether the Preview tags come off the prices, and the B300 waitlist, the one inventory line in the docs 4. A two-node job started on launch day that runs the full 14-day cap hits it on November 4, and the restart is another bet on capacity being there 4.

Get Data Center by email, free

Who is building AI's data centers, and who is paying for them. In our daily email, every weekday.

Loading HOOD…

Reader comments

0 comments

    More in Data Center

    All in this topic →

    Data Center

    Murati's Thinking Machines just took on Firmus's delivery risk

    Mira Murati's lab signed its models to Firmus's Asian AI factories mid-fundraise. The contract is real, but so is the US$3 billion Firmus must raise first, and the OpenAI termination clause shows what a delay would cost.

    Data Center

    Nebius's NEOM demand receipt is a preliminary agreement sitting under a one-year loan

    The Saudi framework Nebius signed at GTC Berlin is billed as proof of international demand, but a preliminary agreement for capacity that arrives in 2027 does not collateralize a loan due in 364 days.

    Data Center

    Jane Street paid $109 a share for CoreWeave now near $54, with $6 billion of rented compute on the line

    The quant trading firm paid $109 a CoreWeave share in April and now marks it at about $54. Its $6 billion of rented AI compute depends on a landlord whose interest bill is growing faster than its revenue.

    Data Center

    Comfort Systems beat everything, refused the AI labs, and the stock fell 9%

    Comfort Systems beat every estimate and booked a record $17.8 billion backlog, yet CFO Bill George told investors the company has not reached terms it would accept from frontier AI labs and colocation providers. The stock fell 9 percent anyway, and investors must judge discipline against lost growth.

    Data Center

    A $90 million Korean filing says Sanmina's AI racks are still selling. The tape says otherwise.

    A Korean supplier's mandatory filing shows a third straight year of data-center orders flowing to Sanmina's India operations, worth about $90 million, even as the stock shed 30.4% in four weeks. Both camps get tested at the November 9 fiscal-year report.

    Data Center

    CoreWeave's $104.2 billion backlog depends on 2.7 gigawatts it has not switched on

    CoreWeave's $104.2 billion revenue backlog rests on 4.2 gigawatts of contracted power, of which only 1.5 gigawatts is switched on. The November earnings report will show whether the backlog is a contract or a construction schedule.

    Get the newsletter

    The day's AI and market news, in your inbox every weekday.