Skip to content
Sign in
  • Browse all toolsFilter by category and pricing
  • Browse categoriesWriting, code, image, audio and more
  • Compare toolsPut up to three side by side
  • Read the blogGuides and comparisons
All categories

LLM Infrastructure

Tools for serving, routing, evaluating and monitoring large language models

28tools listed

Pricing mix

  • 9 Free
  • 15 Freemium
  • 4 Paid

15 tools match

  • Unified AI development, training, and inference across a global network of GPU cloud providers.

    Freemium
  • Deepgram ASR

    www.deepgram.com

    Speech-to-text APIs, text-to-speech, and voice agents for real-time voice applications.

    Freemium
  • Entry Point

    www.entrypointai.com

    Transform data with prompts, generate training examples, and fine-tune task-specific AI models.

    Freemium
  • Dify

    www.dify.ai

    Build AI agents, visual workflows, and RAG applications with cloud, VPC, or self-hosted deployment.

    Freemium
  • Knit

    www.promptknit.com

    Store, edit and test AI prompts with image inputs, function call simulation and version history.

    Freemium
  • Spark Engine

    www.sparkengine.ai

    AI tools for outreach, agentic systems, adaptive desktop interfaces, and business dashboards.

    Freemium
  • DapperGPT

    www.dappergpt.com

    A multi-model AI chat interface with file uploads, search, tools, MCP, and custom prompts.

    Freemium
  • You.com

    www.you.com

    Web search, content extraction, research, and model inference APIs for AI applications.

    Freemium
  • AssemblyAI

    www.assemblyai.com

    Speech-to-text, text-to-speech, and speech understanding APIs for voice applications.

    Freemium
  • Novita.ai

    www.novita.ai

    Model APIs, on-demand GPUs, and agent sandboxes for building and scaling AI applications.

    Freemium
  • 1Panel

    www.1panel.pro

    Open-source Linux server management with AI model deployment, website hosting, containers, and backups.

    Freemium
  • AIMLAPI

    www.aimlapi.com

    API access to chat, reasoning, image, video, audio and search models with unified billing.

    Freemium
  • Docker Model Runner

    docs.docker.com

    Model-running tooling with REST API documentation, configuration guides, and IDE and Open WebUI integration guides.

    Freemium
  • Ollama

    www.ollama.com

    Build with open models locally or in the cloud, with prompt privacy and usage-based cloud pricing.

    Freemium
  • FastMCP

    www.gofastmcp.com

    A Python framework for building MCP servers, clients, and interactive applications.

    Freemium