Looyas
Looyas
Tunisie

CL-08 - AI Agent harness

ai/mlagentic-aiBenchmarking/EvaluationPython/PyTorch

Publié il y a 20 jours

Stage
⏱️4-6 mois
💼Présentiel
📅Expiré il y a 6 jours
Anglais: clarté > perfection.

Description du poste

Design and implement an evaluation harness for AI agents. Define and instrument key metrics (task completion, tool-call correctness, hallucination detection, silent failure identification), run agents against controlled scenarios, and score their behavior systematically.

Technologies: Python, LangChain/LangGraph, RAGAS, DeepEval, guardrails, context & memory management, Git, Docker.