Skip to main content

Frequently Asked Questions

Support

How can I report an issue with Zeno?

Please send us a message on our Discord channel, file a bug on GitHub, or email hello@zenoml.com if you run into any issues!

General

What is Zeno?

Zeno is an AI evaluation platform. It lets you explore your data and model outputs, discover model failures, and create rich, interactive reports. Check out public projects and reports on Zeno Hub!

Is Zeno Open Source?

Zeno is fully open source! You can either use our hosted Zeno Hub or host it yourself. We welcome contributions from the community to various aspects of Zeno, including:

How do I get started?

You can start by exploring public projects and reports to get an idea of how Zeno works. To create your own projects please follow the Getting Started Guide.

How do I create a new project?

Check out the Getting Started Guide to learn how to use the zeno-client Python library to create projects, upload data, and upload AI system outputs.

How do I get data for evaluation?

Zeno does not provide evaluation data. We recommend you start with a dataset similar to your task from public repositories such as 🤗 datasets, gather data from users or customers, or bootstrap an evaluation set using a model or system such as ChatGPT.

How do I get model outputs?

Zeno also does not provide or run AI systems. Run models locally using services such as 🤗 transformers and upload the results to Zeno.

Can I run Zeno locally?

Check out the Zeno Hub Developer documentation for instructions on how to run the Docker containers and host Zeno yourself.

Misc

Where did the name Zeno come from?

Zeno is named after Zeno of Elea, the Greek philosopher. Zeno's Dichotomy paradox states "That which is in locomotion must arrive at the half-way stage before it arrives at the goal", emblematic of the nearly infinite ways in which you can slice your data and discover model behaviors in Zeno.

Zeno of Elea