Staff Software Engineer - AI/ML Platform at GEICO

You're a seasoned Staff Software Engineer with at least 8 years of experience, including 3+ years focused on machine learning infrastructure and deployment at scale, and at least 2 years specifically with large language models (LLMs). A Bachelor's degree in a technical field or equivalent experience is required. **What makes it worth a look...** GEICO is offering a full-time hybrid role in Bethesda, MD, New York City, NY, or Palo Alto, CA, with an annual salary range of $115,000 to $300,000. They also provide a 401K with a 6% match vested from day one. **You might be a good fit if you...** * Have proven experience working with open-source LLMs (Llama, Mistral, Gemma, etc.) and Kubernetes, including GPU scheduling. * Possess deep expertise in Azure services like AKS, Azure ML, and Azure DevOps, with proficiency in Terraform. * Have hands-on experience with LLM inference optimization using tools such as vLLM or TensorRT-LLM. * Are skilled in implementing and operating feature stores.