confident-ai/deepeval

Easily fine-tune, evaluate and deploy Gemma 4, Qwen3.5, Qwen3.6, gpt-oss, DeepSeek-R1, or

the LLM vulnerability scanner

Holistic Evaluation of Language Models (HELM) is an open source Python framework created b

Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends