AI Evaluation Engineer
Company: VirtualVocations
Location: Cedar Rapids
Posted on: March 23, 2025
|
|
|
Job Description:
A company is looking for an AI Evaluation Engineer.
Key Responsibilities
Design and implement evaluation frameworks and performance metrics
for AI systems
Develop tools and processes for observability throughout the AI
development lifecycle
Collaborate cross-functionally to integrate monitoring and testing
methodologies into production workflows
Required Qualifications
MS/PhD in Computer Science, Machine Learning, Artificial
Intelligence, or a related field
2+ years of experience evaluating AI and/or ML systems focused on
performance metrics
Hands-on experience with observability and analytics platforms
Proficiency in Python and experience with machine learning
frameworks like scikit-learn, TensorFlow, or PyTorch
Knowledge of retrieval-augmented generation (RAG) and agent-based
workflows
Keywords: VirtualVocations, Cedar Rapids , AI Evaluation Engineer, Engineering , Cedar Rapids, Iowa
|
Click
here to apply!
|
