Senior Software Engineer, Core Infrastructure at Harvey

This role is for an experienced infrastructure expert with at least four years of experience who has a deep background in scaling distributed systems and managi

Work type: hybrid

Location: San Francisco

Salary: $200,000 – $250,000/yr

Type: Full-time

This role is for an experienced infrastructure expert with at least four years of experience who has a deep background in scaling distributed systems and managing multi-cloud environments. The ideal candidate has specialized knowledge in Kubernetes and Infrastructure as Code and feels comfortable handling the high-stakes traffic of a global AI platform. **What makes it worth a look...** The compensation is high for a senior role, and the company is at a major inflection point with over 1,000 customers. Since they are solving complex routing and residency issues for AI workloads, you will get to build sophisticated model proxy and rate-limiting systems that most companies haven't tackled yet. **You might be a good fit if you...** * Have hands-on experience with Azure or GCP and tools like Terraform or Pulumi. * Want to solve the "spiky traffic" problems inherent in high-throughput AI inference. * Prefer working in person in San Francisco and value a high-intensity, ownership-driven culture. * Are ready to architect multi-region deployments that meet strict global data residency laws.

View this job on nocollar jobs