Skip to content
Sign in
  • Browse all toolsFilter by category and pricing
  • Browse categoriesWriting, code, image, audio and more
  • Compare toolsPut up to three side by side
  • Read the blogGuides and comparisons
All categories

LLM Infrastructure

Tools for serving, routing, evaluating and monitoring large language models

28tools listed

Pricing mix

  • 9 Free
  • 15 Freemium
  • 4 Paid

28 tools match

  • fal

    www.fal.ai

    Generative media APIs, serverless model deployment, and GPU compute for developers

    Paid
  • Unified AI development, training, and inference across a global network of GPU cloud providers.

    Freemium
  • Deepgram ASR

    www.deepgram.com

    Speech-to-text APIs, text-to-speech, and voice agents for real-time voice applications.

    Freemium
  • Entry Point

    www.entrypointai.com

    Transform data with prompts, generate training examples, and fine-tune task-specific AI models.

    Freemium
  • Dify

    www.dify.ai

    Build AI agents, visual workflows, and RAG applications with cloud, VPC, or self-hosted deployment.

    Freemium
  • Knit

    www.promptknit.com

    Store, edit and test AI prompts with image inputs, function call simulation and version history.

    Freemium
  • Modly

    www.modly.ai

    Custom large language model training, fine-tuning, hosting, and maintenance for business data and workflows.

    Paid
  • Spark Engine

    www.sparkengine.ai

    AI tools for outreach, agentic systems, adaptive desktop interfaces, and business dashboards.

    Freemium
  • DapperGPT

    www.dappergpt.com

    A multi-model AI chat interface with file uploads, search, tools, MCP, and custom prompts.

    Freemium
  • Metatext

    www.metatext.ai

    Compare LLM pricing and benchmarks, browse AI datasets and agent tools, and find AI jobs.

    Free
  • You.com

    www.you.com

    Web search, content extraction, research, and model inference APIs for AI applications.

    Freemium
  • Credal.ai

    www.credal.ai

    Build and govern enterprise MCP servers and AI agents with scoped context, permissions, and cost tracking.

    Paid
  • AssemblyAI

    www.assemblyai.com

    Speech-to-text, text-to-speech, and speech understanding APIs for voice applications.

    Freemium
  • Novita.ai

    www.novita.ai

    Model APIs, on-demand GPUs, and agent sandboxes for building and scaling AI applications.

    Freemium
  • Promptmetheus Forge Playground

    www.promptmetheus.com

    A free prompt engineering playground for composing prompts, testing outputs, and estimating inference costs.

    Free
  • 1Panel

    www.1panel.pro

    Open-source Linux server management with AI model deployment, website hosting, containers, and backups.

    Freemium
  • sub2api

    www.github.com

    Open-source AI API gateway for unified subscription access and shared quota distribution.

    Free
  • LEANN

    www.github.com

    Open-source vector database for storage-efficient semantic search and local RAG on personal data.

    Free
  • WeKnora

    www.github.com

    Open-source knowledge framework for document search, RAG, reasoning agents and a self-maintaining wiki.

    Free
  • Anthropic CLI

    www.github.com

    Official Claude API command-line tool for messages, agents, sessions, file uploads, and API scripting.

    Free
  • Beam

    www.beam.cloud

    Cloud VMs, isolated sandboxes, and serverless GPUs for AI agents and model inference.

    Paid
  • AIMLAPI

    www.aimlapi.com

    API access to chat, reasoning, image, video, audio and search models with unified billing.

    Freemium
  • Docker Model Runner

    docs.docker.com

    Model-running tooling with REST API documentation, configuration guides, and IDE and Open WebUI integration guides.

    Freemium
  • Ollama

    www.ollama.com

    Build with open models locally or in the cloud, with prompt privacy and usage-based cloud pricing.

    Freemium
  • Compress AI coding agent output and route heavy tasks to cheaper models with shareable pipelines.

    Free
  • FastMCP

    www.gofastmcp.com

    A Python framework for building MCP servers, clients, and interactive applications.

    Freemium
  • Free Claude Code

    www.github.com

    Connect coding agents to free, paid, subscription, and local models through a searchable model catalog.

    Free
  • Claude Code Router

    www.github.com

    A local model gateway for routing coding agents across providers, models, accounts, and tools.

    Free