Senior Software Engineer, Inference Platform at MongoDB

This role is ideal for a Senior Backend or Infrastructure Engineer with at least 5 years of experience who wants to work at the intersection of distributed syst

Work type: onsite

Location: Palo Alto

Salary: $126,000 – $248,000/yr

Type: Full-time

This role is ideal for a Senior Backend or Infrastructure Engineer with at least 5 years of experience who wants to work at the intersection of distributed systems and AI. You should have a deep understanding of high-performance languages like Go, Rust, or C++ and experience building multi-tenant cloud architectures. While you don't need to be an ML researcher, you should be comfortable productionizing models and working with Kubernetes and GPU orchestration. You will be joining the Search and AI Platform team in Palo Alto to build the core infrastructure for MongoDB Atlas’s vector search and inference capabilities. The compensation is highly competitive, reaching up to $248k base, complemented by strong benefits like 20 weeks of parental leave and equity. This is a high-impact opportunity to work with the Voyage.ai team to scale real-time AI features for thousands of global customers. **You might be a good fit if you:** * Have a proven track record of building low-latency, scalable backend systems in Go, Rust, or Python. * Are excited about DevOps/Infrastructure challenges like GPU utilization, auto-scaling, and latency-aware routing. * Have experience with or a strong interest in vector search systems (Faiss, HNSW) and ML serving runtimes like vLLM. * Prefer a hybrid work model based in Palo Alto.

View this job on nocollar jobs