LangChain offers various types of evaluators to help you measure performance and integrity on diverse data,
Each evaluator type in LangChain comes with ready-to-use implementations and an extensible API that allows for customization according to your unique requirements. Here are some of the types of evaluators we offer:
String Evaluators: These evaluators assess the predicted string for a given input, usually comparing it against a reference string.
Trajectory Evaluators: These are used to evaluate the entire trajectory of agent actions.
Comparison Evaluators: These evaluators are designed to compare predictions from two runs on a common input.
references:
https://python.langchain.com/v0.1/docs/guides/productionization/evaluation/
No comments:
Post a Comment