Looyas
Looyas
Tunisia

CL-08 - AI Agent harness

ai/mlagentic-aiBenchmarking/EvaluationPython/PyTorch

Published about 2 months ago

Internship
⏱️4-6 months
💼On-site
📅Expired about 1 month ago
Your CV evolves; it does not need to be frozen perfect.

Job description

Design and implement an evaluation harness for AI agents. Define and instrument key metrics (task completion, tool-call correctness, hallucination detection, silent failure identification), run agents against controlled scenarios, and score their behavior systematically.

Technologies: Python, LangChain/LangGraph, RAGAS, DeepEval, guardrails, context & memory management, Git, Docker.