Skip to content
Sign in
  • Browse all toolsFilter by category and pricing
  • Browse categoriesWriting, code, image, audio and more
  • Compare toolsPut up to three side by side
  • Read the blogGuides and comparisons
All categories

LLM Infrastructure

Tools for serving, routing, evaluating and monitoring large language models

28tools listed

Pricing mix

  • 9 Free
  • 15 Freemium
  • 4 Paid

28 tools

Filters

Pricing

  • fal

    Generative media APIs, serverless model deployment, and GPU compute for developers

    Image & Video
    Paid

  • NVIDIA DGX Cloud Lepton

    Unified AI development, training, and inference across a global network of GPU cloud providers.

    Code & Development
    Freemium

  • Deepgram ASR

    Speech-to-text APIs, text-to-speech, and voice agents for real-time voice applications.

    Audio & Speech
    Freemium

  • Entry Point

    Transform data with prompts, generate training examples, and fine-tune task-specific AI models.

    Productivity & Automation
    Freemium

  • Dify

    Build AI agents, visual workflows, and RAG applications with cloud, VPC, or self-hosted deployment.

    Code & Development
    Freemium

  • Knit

    Store, edit and test AI prompts with image inputs, function call simulation and version history.

    Code & Development
    Freemium

  • Modly

    Custom large language model training, fine-tuning, hosting, and maintenance for business data and workflows.

    LLM Infrastructure
    Paid

  • Spark Engine

    AI tools for outreach, agentic systems, adaptive desktop interfaces, and business dashboards.

    Productivity & Automation
    Freemium

  • DapperGPT

    A multi-model AI chat interface with file uploads, search, tools, MCP, and custom prompts.

    Productivity & Automation
    Freemium

  • Metatext

    Compare LLM pricing and benchmarks, browse AI datasets and agent tools, and find AI jobs.

    Research & Analysis
    Free

  • You.com

    Web search, content extraction, research, and model inference APIs for AI applications.

    Research & Analysis
    Freemium

  • Credal.ai

    Build and govern enterprise MCP servers and AI agents with scoped context, permissions, and cost tracking.

    Productivity & Automation
    Paid

  • AssemblyAI

    Speech-to-text, text-to-speech, and speech understanding APIs for voice applications.

    Code & Development
    Freemium

  • Novita.ai

    Model APIs, on-demand GPUs, and agent sandboxes for building and scaling AI applications.

    Code & Development
    Freemium

  • Promptmetheus Forge Playground

    A free prompt engineering playground for composing prompts, testing outputs, and estimating inference costs.

    Code & Development
    Free

  • 1Panel

    Open-source Linux server management with AI model deployment, website hosting, containers, and backups.

    Code & Development
    Freemium

  • sub2api

    Open-source AI API gateway for unified subscription access and shared quota distribution.

    LLM Infrastructure
    Free

  • LEANN

    Open-source vector database for storage-efficient semantic search and local RAG on personal data.

    AI Agents & MCP
    Free

  • WeKnora

    Open-source knowledge framework for document search, RAG, reasoning agents and a self-maintaining wiki.

    AI Agents & MCP
    Free

  • Anthropic CLI

    Official Claude API command-line tool for messages, agents, sessions, file uploads, and API scripting.

    Code & Development
    Free

  • Beam

    Cloud VMs, isolated sandboxes, and serverless GPUs for AI agents and model inference.

    Code & Development
    Paid

  • AIMLAPI

    API access to chat, reasoning, image, video, audio and search models with unified billing.

    Code & Development
    Freemium

  • Docker Model Runner

    Model-running tooling with REST API documentation, configuration guides, and IDE and Open WebUI integration guides.

    Code & Development
    Freemium

  • Ollama

    Build with open models locally or in the cloud, with prompt privacy and usage-based cloud pricing.

    AI Agents & MCP
    Freemium

  • RTK — Rust Token Killer

    Compress AI coding agent output and route heavy tasks to cheaper models with shareable pipelines.

    Code & Development
    Free

  • FastMCP

    A Python framework for building MCP servers, clients, and interactive applications.

    Code & Development
    Freemium

  • Free Claude Code

    Connect coding agents to free, paid, subscription, and local models through a searchable model catalog.

    Code & Development
    Free

  • Claude Code Router

    A local model gateway for routing coding agents across providers, models, accounts, and tools.

    Code & Development
    Free