Model Evaluation

An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controllin

A framework for few-shot evaluation of language models.

BISHENG is an open LLM devops platform for next generation Enterprise AI applications. Powerful and comprehensive features include: GenAI workflow, RAG, Agent, Unified model management, Evaluation, SF

A framework for training and evaluating AI models on a variety of openly available dialogue datasets.

OpenCompass is an LLM evaluation platform, supporting a wide range of models from OpenAI, Anthropic, Gemini, Qwen, GLM, DeepSeek, etc, across 100+ datasets covering knowledge, reasoning, coding, scien

[ICLR'24 spotlight] An open platform for training, serving, and evaluating large language model for tool learning.

The open source research environment for AI researchers to seamlessly train, evaluate, and scale models from local hardware to GPU clusters.