-
Engineers
HawkFlow.ai is a monitoring tool that allows engineers, data scientists, analysts, and product managers to easily track and monitor various aspects of their code, infrastructure, and business. It offers features such as anomaly detection, trend analysis, data size and accuracy monitoring, run time tracking, and integration with existing machine learning infrastructure.22 Jul 2023Readmore -
LLM monitoring
Keywords AI is an LLM API that offers a cost-effective alternative to GPT-4 without compromising on quality. It is also a leading LLM monitoring platform for AI startups, designed to easily monitor and improve LLM applications with just 2 lines of code. It helps debug and ship reliable AI features faster, essentially acting as Datadog for LLM applications.12 Oct 2023Readmore -
AI Monitoring
AI Monitor provides real-time insights and tools to help brands maintain and enhance their visibility across AI-driven platforms like ChatGPT and Google AI Overview. AI Monitor enables businesses to adapt to the new era of Generative Engine Optimization (GEO). It helps brands monitor and protect their reputation in the age of AI Search and stay ahead of the competition.08 Apr 2025Readmore -
LLM evaluation
Confident AI is an all-in-one LLM evaluation platform built by the creators of DeepEval. It offers 14+ metrics to run LLM experiments, manage datasets, monitor performance, and integrate human feedback to automatically improve LLM applications. It works with DeepEval, an open-source framework, and supports any use case. Engineering teams use Confident AI to benchmark, safeguard, and improve LLM applications with best-in-class metrics and tracing. It provides an opinionated solution to curate datasets, align metrics, and automate LLM testing with tracing, helping teams save time, cut inference costs, and convince stakeholders of AI system improvements.31 Jul 2024Readmore -
NYC violations
ViolationWatch is a real-time monitoring platform that tracks NYC building violations, complaints, and compliance updates across major agencies like DOB, FDNY, HPD, DEP, and more. It instantly alerts you when new violations are posted—so you can act fast and avoid expensive fines. It is built for landlords, contractors, and property managers who need to stay compliant.09 May 2025Readmore -
AI evaluation
Future AGI develops advanced AI evaluation and optimization products, enabling automated quality assessment and performance enhancement for AI models. It offers a comprehensive platform to help enterprises achieve high accuracy in AI applications across software and hardware, replacing manual QA with Critique Agents and custom metrics.22 Nov 2024Readmore -
AI evaluation
Maxim is an end-to-end AI evaluation & observability platform that helps you test and deploy AI apps with greater speed & confidence. Its developer stack includes tools for the full AI lifecycle: experimentation, pre-release testing, & post-release monitoring. It offers features like agent simulation and evaluation, prompt engineering tools, observability, and continuous quality monitoring. Maxim supports various AI frameworks and provides SDKs, CLI, and webhook support.01 Dec 2024Readmore