Startup Ideas AI

Portkey enables companies to develop, launch, maintain & iterate over their generative AI apps and features faster. It is an LLMOps platform that speeds up your development and your app.

Vellum is the development platform for building LLM apps with tools for prompt engineering, semantic search, version control, testing, and monitoring. Compatible with all major LLM providers.

Open source monitoring and production toolkit for AI apps

HoneyHive provides evaluation and observability tools for teams building Generative AI applications.

Middle layer for AI applications that allows you to build better and faster.

Observo.ai is an AI-powered observability platform that helps businesses reduce security and observability costs while resolving incidents faster.

Middleware is a full-stack cloud observability platform that boosts operational efficiency by monitoring infrastructure, logs, APM, and more.

Build reliable conversational AI. Evaluate your AI system. Observability and Analytics platform for LLM apps.

Trainkore is a prompting and RAG (Retrieval-Augmented Generation) platform designed to automate prompts and save costs. It offers features like auto prompt generation, model switching, evaluation, observability, and a prompt playground. It integrates with various AI providers and frameworks like Langchain and LlamaIndex.

OpenLIT is an open-source GenAI and LLM observability platform native to OpenTelemetry. It provides Application Performance Monitoring (APM) & Observability for GenAI and LLM applications, unifying traces and metrics in a single interface. OpenLIT simplifies AI development workflows, especially for Generative AI and LLMs, by streamlining tasks like experimenting with LLMs, organizing prompts, and securely handling API keys.

An open-source AI gateway designed for managing multiple LLM providers such as OpenAI, Anthropic, Gemini, Ollama, Mistral, and Cohere. It offers built-in analytics, guardrails, rate limiting, caching, and administrative controls. It supports both HTTP and gRPC interfaces.

Prompteus is a platform designed for developers to build, deploy, and scale AI workflows using a no-code editor. It offers features like multi-LLM orchestration, adaptive caching, and built-in guardrails to ensure cost-effective, compliant, and robust AI operations. It provides observability, cost reduction, safety guardrails, and intelligent request routing for AI integrations.

PerfAgents is an enterprise monitoring platform that combines testing and monitoring into a single pane of glass. It offers synthetic monitoring, application performance management, observability, DevOps, and SRE tools. It supports multiple frameworks like Playwright, Selenium, Puppeteer, and Cypress, and allows users to monitor user flows, REST APIs, and website performance from multiple locations.

Neurelo simplifies database experiences by providing instant AI-powered REST and GraphQL APIs, GitSchema, Observability, and more for MongoDB, Postgres, and MySQL. It empowers AI agents to securely access databases in real-time, simplifying data queries while ensuring robust access control and observability. Neurelo Connect is the missing link between AI agents and databases, offering secure and deterministic database access.

Small Hours is an AI-powered observability platform that transforms how development teams manage and resolve software issues. With automated root cause analysis and issue triaging, Small Hours enables faster diagnosis and resolution of problems. It streamlines on-call rotations and keeps engineers focused on what matters. Small Hours supports OpenTelemetry for seamless integration with any stack. It hooks into existing alarms to identify critical issues, connects codebases and runbooks as context and instructions, and intelligently triages issues and generates pull requests. Optimized for enterprise velocity and scale, Small Hours is built by former engineers of Amazon.

Pi Labs offers an AI-powered platform designed to automatically build evaluation systems (evals) for AI applications, particularly those involving Large Language Models (LLMs) and agents. It enables users to create custom scoring models that precisely match user feedback and prompts, ensuring highly accurate and consistent evaluation. The platform integrates seamlessly with various existing tools and provides a fast, highly accurate foundation model called Pi Scorer for comprehensive metrics, observability, and agent control across the entire AI stack.