Skip to content
Sign in
  • Browse all toolsFilter by category and pricing
  • Browse categoriesWriting, code, image, audio and more
  • Compare toolsPut up to three side by side
  • Read the blogGuides and comparisons
All categories

LLM Infrastructure

Tools for serving, routing, evaluating and monitoring large language models

28tools listed

Pricing mix

  • 9 Free
  • 15 Freemium
  • 4 Paid

15 tools match

Filters

Pricing

Clear all
PricingFreemium

  • NVIDIA DGX Cloud Lepton

    Unified AI development, training, and inference across a global network of GPU cloud providers.

    Code & Development
    Freemium

  • Deepgram ASR

    Speech-to-text APIs, text-to-speech, and voice agents for real-time voice applications.

    Audio & Speech
    Freemium

  • Entry Point

    Transform data with prompts, generate training examples, and fine-tune task-specific AI models.

    Productivity & Automation
    Freemium

  • Dify

    Build AI agents, visual workflows, and RAG applications with cloud, VPC, or self-hosted deployment.

    Code & Development
    Freemium

  • Knit

    Store, edit and test AI prompts with image inputs, function call simulation and version history.

    Code & Development
    Freemium

  • Spark Engine

    AI tools for outreach, agentic systems, adaptive desktop interfaces, and business dashboards.

    Productivity & Automation
    Freemium

  • DapperGPT

    A multi-model AI chat interface with file uploads, search, tools, MCP, and custom prompts.

    Productivity & Automation
    Freemium

  • You.com

    Web search, content extraction, research, and model inference APIs for AI applications.

    Research & Analysis
    Freemium

  • AssemblyAI

    Speech-to-text, text-to-speech, and speech understanding APIs for voice applications.

    Code & Development
    Freemium

  • Novita.ai

    Model APIs, on-demand GPUs, and agent sandboxes for building and scaling AI applications.

    Code & Development
    Freemium

  • 1Panel

    Open-source Linux server management with AI model deployment, website hosting, containers, and backups.

    Code & Development
    Freemium

  • AIMLAPI

    API access to chat, reasoning, image, video, audio and search models with unified billing.

    Code & Development
    Freemium

  • Docker Model Runner

    Model-running tooling with REST API documentation, configuration guides, and IDE and Open WebUI integration guides.

    Code & Development
    Freemium

  • Ollama

    Build with open models locally or in the cloud, with prompt privacy and usage-based cloud pricing.

    AI Agents & MCP
    Freemium

  • FastMCP

    A Python framework for building MCP servers, clients, and interactive applications.

    Code & Development
    Freemium