Startup Ideas AI

Higress is an AI native API gateway based on Istio and Envoy, which can be extended with Wasm plugins written in Go/Rust/JS. It offers AI Gateway, MCP Server Hosting, Kubernetes ingress controller, Microservice gateway and Security gateway. Higress AI网关提供多模型灵活切换与兜底重试、大模型内容安全与合规、语义化缓存、多 API Key 均衡、Token 配额管理和限流、大模型流量灰度、调用成本审计等能力，帮助企业开发 Agent、管理LLM API.

An open-source AI gateway designed for managing multiple LLM providers such as OpenAI, Anthropic, Gemini, Ollama, Mistral, and Cohere. It offers built-in analytics, guardrails, rate limiting, caching, and administrative controls. It supports both HTTP and gRPC interfaces.