PromptLayer
PromptLayer is a platform for prompt engineering. It also helps with the LLM observability to visualize requests, version prompts, and track usage.
While
PromptLayer
does have LLMs that integrate directly with LangChain (e.g.PromptLayerOpenAI
), using a callback is the recommended way to integratePromptLayer
with LangChain.
Installation and Setupβ
To work with PromptLayer
, we have to:
- Create a
PromptLayer
account - Create an api token and set it as an environment variable (
PROMPTLAYER_API_KEY
)
Install a Python package:
pip install promptlayer
Callbackβ
See a usage example.
import promptlayer # Don't forget this import!
from langchain.callbacks import PromptLayerCallbackHandler
API Reference:PromptLayerCallbackHandler
LLMβ
See a usage example.
from langchain_community.llms import PromptLayerOpenAI
API Reference:PromptLayerOpenAI
Chat Modelsβ
See a usage example.
from langchain_community.chat_models import PromptLayerChatOpenAI
API Reference:PromptLayerChatOpenAI