Python SDK for Agent AI Observability, Monitoring and Evaluation Framework. Includes features like agent, llm and tools tracing, debugging multi-agentic system, self-hosted dashboard and advanced analytics with timeline and execution graph view

Deliver safe & effective language models

Framework for testing vulnerabilities of large language models (LLM).

MIT-licensed Framework for LLMs, RAGs, Chatbots testing. Configurable via YAML and integrable into CI pipelines for automated testing.

A tool for testing and comparing the performance of different Large Language Model APIs. 一个用于测试和比较不同大语言模型API性能的工具。

Open-source test management and generation for conversational Gen AI applications. Build and run context-specific test sets. Collaborate with subject matter experts to ensure relevance and quality.

Tiny QA Benchmark++ a micro-benchmark suite (52-item gold + on-demand multilingual synthetic packs), generator CLI, and CI-ready eval harness for ultra-fast LLM smoke-testing & regression-catching.

Test your production LLMs and simulate users

Create an evaluation framework for your LLM based app. Incorporate it into your test suite. Lay the monitoring foundation.

LLM Performance Testing | K6 + Grafana + InfluxDB | A tiny toolkit for load testing and benchmarking OpenAI-like inference endpoints using K6 + Grafana + InfluxDB

g4f-working is a daily-updated list of working no-auth AI providers and models from @xtekky/gpt4free. It helps developers, testers, and AI enthusiasts instantly find which models are currently online and accessible without any API keys, tokens, or cookies.

API Ninja simplifies API testing by allowing users to define test flows in plain English.

Rage4j is a java library thats helps evaluate LLM's based on scientifically grounded metrics

The prompt engineering, prompt management, and prompt evaluation tool for Go.

Red-team audit on deepseek AI by lala aka NeonXploit (operation dragon Glitch)

A comprehensive corpus of interconnected texts and protocols designed as a conceptual stress-test for advanced AI.

LLM Testing with gpt4all

A community-driven archive of AI prompts and responses. Log, compare, and contribute structured examples to build a searchable public prompt-response database.

Official public release of MirrorLoop Core (v1.3 – April 2025)