FastChat

FastChat is an open platform for training, serving, and evaluating large language model based chatbots

The core features include:

The training and evaluation code

Working with state-of-the-art models (e.g., Vicuna).

A distributed multi-model serving system

Includes web UI and OpenAI-compatible RESTful APIs.

News

• [2023/08] 🔥 We released Vicuna v1.5 based on Llama 2 with 4K and 16K context lengths. Download weights.

• [2023/08] 🔥 We released LongChat v1.5 based on Llama 2 with 32K context lengths. Download weights.

• [2023/07] We released Chatbot Arena Conversations, a dataset containing 33k conversations with human preferences. Download it here.

• [2023/06] We introduced MT-bench, a challenging multi-turn question set for evaluating chatbots. Check out the blog post.

• [2023/06] We introduced LongChat, our long-context chatbots and evaluation tools. Check out the blog post.

• [2023/05] We introduced Chatbot Arena for battles among LLMs. Check out the blog post.

• [2023/03] We released Vicuna: An Open-Source Chatbot Impressing GPT-4 with 90% ChatGPT Quality. Check out the blog post.

More

• [2023/06] We introduced MT-bench, a challenging multi-turn question set for evaluating chatbots. Check out the blog post.
• [2023/06] We introduced LongChat, our long-context chatbots and evaluation tools. Check out the blog post.
• [2023/05] We introduced Chatbot Arena for battles among LLMs. Check out the blog post.
• [2023/03] We released Vicuna: An Open-Source Chatbot Impressing GPT-4 with 90% ChatGPT Quality. Check out the blog post.