Skip to content
@truefoundry

TrueFoundry

Build fast, secure and cost-efficient ML/LLM Apps

TrueFoundryTrueFoundry

TrueFoundry - Reduce time to value on Gen AI & ML initiatives

Twitter Follow Artifact Hub YouTube Slack Signup

What is TrueFoundry?

  • A low-latency enterprise AI Gateway with MCP server integrations, guardrails, observability, latency-based routing, model fallback, caching, quota and access control (on-premise, VPC or cloud).
  • A cloud-agnostic PaaS running on Kubernetes that standardizes AI applications development, deployment and observability using developer-friendly APIs. Plugs and play with your existing stack without vendor lock-in bringing state of the art industry standards.

Govern, Deploy, Scale & Trace Agentic AI in One Unified Platform

  • NEW 🔥 Free Sign Up - Sign Up for Free and Deploy on your cloud in under 10 minutes
  • AI Gateway - Enterprise-Ready AI Gateway for secure, high-performance proxy to 1000+ models with observability, governance, rate limits, budgets, guardrails, fallbacks, and load balancing.
  • NEW 🔥 MCP Gateway - Secure Access to MCP Servers and Agent Orchestration
  • NEW 🔥 Tracing - End-to-End Observability for AI Agents and Applications
  • AI Engineering - One platform to deploy services, jobs, notebooks, track experiments, train/serve models, and ship DAG workflows.
  • TrueFoundry SDK & CLI - Python/TypeScript SDKs & CLI for programmatic control
    • Track Experiments, register and versions models, artifacts and prompts
    • Deploy Services, Jobs, Notebooks, SSH Servers, Helm applications
    • Build and Deploy DAG workflows
    • Enable CI/CD for your deployments
    • Programmatically access TrueFoundry APIs
  • TrueFoundry Docs - Guides and API Reference for the platform

OpenSource

  • KubeElasti - Kubernetes-native scale-to-zero with zero traffic loss, no code changes, and direct integration with kubernetes resources
  • LLM Locust - LLM Locust combines the simplicity of Locust with deep support for LLM-specific benchmarking
  • Cognita - RAG Framework for Building Grounded Applications

Get in touch 💬

👉 Join our Slack community!

🐦 Follow the latest from TrueFoundry team on Twitter @truefoundry

Pinned Loading

  1. llm-locust llm-locust Public

    LLM Locust combines the simplicity of Locust with deep support for LLM-specific benchmarking

    TypeScript 25 11

  2. cognita cognita Public archive

    RAG (Retrieval Augmented Generation) Framework for building modular, open source applications for production by TrueFoundry

    Python 4.4k 389

  3. infra-charts infra-charts Public

    Helm Repo for TrueFoundry Platform Charts

    Go Template 5 5

  4. truefoundry-python-sdk truefoundry-python-sdk Public

    TrueFoundry Python SDK for convenient interaction with TrueFoundry API.

    Python 1

  5. truefoundry-typescript-sdk truefoundry-typescript-sdk Public

    TrueFoundry Typescript SDK for convenient interaction with TrueFoundry API.

    TypeScript

Repositories

Showing 10 of 112 repositories
  • CruiseKube Public

    CruiseKube is an intelligent Kubernetes resource optimization controller that automatically monitors, analyzes, and applies resource recommendations to improve cluster efficiency and reduce costs.

    truefoundry/CruiseKube’s past year of commit activity
    Go 68 4 3 3 Updated Apr 18, 2026
  • models Public

    Community-maintained registry of AI/LLM model configurations - pricing, features, and limits across 19 providers and 1000+ models

    truefoundry/models’s past year of commit activity
    4 MIT 1 0 11 Updated Apr 18, 2026
  • truefoundry/tfy-ai-gateway-skills’s past year of commit activity
    Python 0 0 0 1 Updated Apr 17, 2026
  • truefoundry-python-sdk Public

    TrueFoundry Python SDK for convenient interaction with TrueFoundry API.

    truefoundry/truefoundry-python-sdk’s past year of commit activity
    Python 0 1 0 0 Updated Apr 17, 2026
  • truefoundry-typescript-sdk Public

    TrueFoundry Typescript SDK for convenient interaction with TrueFoundry API.

    truefoundry/truefoundry-typescript-sdk’s past year of commit activity
    TypeScript 0 0 0 0 Updated Apr 17, 2026
  • truefoundry/cruiseKube-frontend’s past year of commit activity
    TypeScript 0 0 0 2 Updated Apr 17, 2026
  • infra-charts Public

    Helm Repo for TrueFoundry Platform Charts

    truefoundry/infra-charts’s past year of commit activity
    Go Template 5 5 0 4 Updated Apr 17, 2026
  • mcp-google-map Public Forked from cablate/mcp-google-map

    A powerful Model Context Protocol (MCP) server providing comprehensive Google Maps API integration with LLM processing capabilities.

    truefoundry/mcp-google-map’s past year of commit activity
    TypeScript 0 MIT 66 0 10 Updated Apr 17, 2026
  • tfy-mcp-server-deployment-example Public

    Example deployment of an mcp server using agent skills

    truefoundry/tfy-mcp-server-deployment-example’s past year of commit activity
    TypeScript 1 0 0 8 Updated Apr 17, 2026
  • mcp-servers-api Public Forked from truefoundry/mcp-servers

    Create a deployed server that dynamically chooses which mcp server to use with the selected tools.

    truefoundry/mcp-servers-api’s past year of commit activity
    Python 0 2 0 27 Updated Apr 17, 2026

Top languages

Loading…

Most used topics