Senior AI Data Engineer at Veeva

You're a seasoned AI professional with at least 5 years of experience in designing and deploying automated evaluation pipelines for complex agentic AI systems,

Work type: remote

Location: California - San Luis Obispo

Salary: $110,000 – $270,000/yr

Type: Full-time

You're a seasoned AI professional with at least 5 years of experience in designing and deploying automated evaluation pipelines for complex agentic AI systems, specifically focusing on LLM failure modes and data validation. A Bachelor's degree in a quantitative field like Data Science or Computer Science is required. **What makes it worth a look...** Veeva, a Public Benefit Corporation in the life sciences cloud industry, is hiring for this fully remote Senior AI Data Engineer role in the US or Canada, offering a base salary of $110,000 - $270,000 per year. They are known for their mission-driven approach and commitment to employee and customer success. **You might be a good fit if you...** * Have 5+ years of experience using Python to build custom evaluation frameworks and integrate pipelines with CI/CD. * Possess a deep understanding of LLM failure modes like hallucination and incoherence, and can craft adversarial test data. * Are comfortable debugging agentic systems and tracing internal reasoning to pinpoint failures. * Have experience with advanced prompt engineering and quality metrics such as task success rate and semantic similarity.

View this job on nocollar jobs