The Stack · LLM gateways & inference API

Modal

Serverless GPU/CPU cloud where you define container + hardware in Python code and run per-second-billed inference, batch, and training jobs.

API keyFreemium🟡 agent: manual only

Get API key → human signup required Docs Website

CategoryLLM gateways & inference

TypeAPI service

Authapi-key

PricingFreemium

Agent signup🟡 manual only

SDKsPython, CLI

Pricing: Starter free with $30/mo credits; per-second GPU pricing (T4 to B200); Team plan $250/mo

🟡 Agents: manual only

Manual — signup needs a human (card, verification, or sales).

Account via GitHub/Google login, then tokens are created with the `modal token new` CLI (browser step) — human-in-the-loop; $30/mo free credits after

Modal — Serverless GPU/CPU cloud where you define container + hardware in Python code and run per-second-billed inference, batch, and training jobs.
Website: https://modal.com
Docs: https://modal.com/docs
Get a key: https://modal.com/signup
Agent signup: manual only — Account via GitHub/Google login, then tokens are created with the `modal token new` CLI (browser step) — human-in-the-loop; $30/mo free credits after
Auth: api-key
Pricing: freemium — Starter free with $30/mo credits; per-second GPU pricing (T4 to B200); Team plan $250/mo
Full record: https://dreaming.press/api/tools/modal.json

Machine record: /api/tools/modal.json

Quickstart

import modal
app = modal.App("hello")

@app.function(gpu="A100")
def generate(prompt: str):
    # load model + run inference on the GPU
    return prompt.upper()

@app.local_entrypoint()
def main():
    print(generate.remote("hello from a serverless GPU"))

python · full docs →

Modal in our coverage

The Founder's Wire, September 22: Grok 4.7 Lands in Every Copilot Tier at $2/$6, StepFun Undercuts the Frontier by 7x, and Alibaba Maps a 10-Trillion-Parameter Road

2026-09-22

Serverless GPU Compute, Explained: The Providers, the Prices, and When Scale-to-Zero Pays (September 2026)

2026-09-18

The Founder's Wire, September 15: The Labs Asked for a Brake, and the Market Repriced the Whole AI Trade in a Day

2026-09-15

The Open-Source LLM Leaderboard, September 2026: The Best Open-Weight Models to Run Locally (and Which You Can Actually Ship)

2026-09-15

The Founder's Wire, September 12: OpenAI Turns Its Codex Harness Into an API, and DeepSeek's V4.1 Flash Drops the Cheap-Agent Floor Again

2026-09-12

OpenAI's Agents API vs the Agents SDK vs LangGraph: Who Should Run Your Agent Loop in 2026

2026-09-12

Modal FAQ

What is Modal?

Modal is Serverless GPU/CPU cloud where you define container + hardware in Python code and run per-second-billed inference, batch, and training jobs. It's in the LLM gateways & inference category of the dreaming.press tool directory.

Is Modal free?

Modal is freemium — free to start, paid plans for scale. Starter free with $30/mo credits; per-second GPU pricing (T4 to B200); Team plan $250/mo.

Can an AI agent sign up for Modal automatically?

Not automatically — signup requires a human (a credit card, verification, or a sales conversation). Account via GitHub/Google login, then tokens are created with the `modal token new` CLI (browser step) — human-in-the-loop; $30/mo free credits after.

Does Modal have an MCP server?

Modal does not publish an official MCP server as of our last check.

Is Modal open source?

Modal is a hosted API service, not an open-source project.

What languages does Modal support?

Modal offers Python, CLI.