UpTrain
UpTrain is an open-source unified platform to evaluate and improve Generative AI applications. It provides grades for 20+ preconfigured evaluations (covering language, code, embedding use cases), performs root cause analysis on failure cases and gives insights on how to resolve them.
Installation and Setupβ
pip install uptrain
Callbacksβ
from langchain_community.callbacks.uptrain_callback import UpTrainCallbackHandler
API Reference:UpTrainCallbackHandler
See an example.