Confident AI
Confident AI is a creator of the
DeepEval
.DeepEval is a package for unit testing LLMs. Using
DeepEval
, everyone can build robust language models through faster iterations using both unit testing and integration testing. `DeepEval provides support for each step in the iteration from synthetic data creation to testing.
Installation and Setupβ
You need to get the DeepEval API credentials.
You need to install the DeepEval
Python package:
pip install deepeval
Callbacksβ
See an example.
from langchain.callbacks.confident_callback import DeepEvalCallbackHandler
API Reference:DeepEvalCallbackHandler