Chatbot Arena – The LLM Benchmark Platform
To shake things up a bit, Chatbot Arena was created by the Large Model Systems Organization. It’s an open research group founded by students and professors from UC Berkeley.
They aim to make large models accessible to all by using open datasets and models. They also use evaluation tools. The team at LMSYS develops large language models, makes them available to the public and also works on distributed systems that can accelerate LLMs’ training and inference.
Chatbot Arena provides a platform where users can submit new language models for evaluation and contribute to the benchmark.
Source:
https://www.kdnuggets.com/2023/05/chatbot-arena-llm-benchmark-platform.html