Senior Software Engineer, Inference Platform at MongoDB

This role is ideal for a Senior Backend or Infrastructure Engineer with at least 5 years of experience who wants to work at the intersection of distributed syst

Work type: onsite

Location: Palo Alto

Salary: $126,000 – $248,000/yr

Type: Full-time

Summary

This role is ideal for a Senior Backend or Infrastructure Engineer with at least 5 years of experience who wants to work at the intersection of distributed systems and AI. You should have a deep understanding of high-performance languages like Go, Rust, or C++ and experience building multi-tenant cloud architectures. While you don't need to be an ML researcher, you should be comfortable productionizing models and working with Kubernetes and GPU orchestration. You will be joining the Search and AI Platform team in Palo Alto to build the core infrastructure for MongoDB Atlas’s vector search and inference capabilities. The compensation is highly competitive, reaching up to $248k base, complemented by strong benefits like 20 weeks of parental leave and equity. This is a high-impact opportunity to work with the Voyage.ai team to scale real-time AI features for thousands of global customers. **You might be a good fit if you:** * Have a proven track record of building low-latency, scalable backend systems in Go, Rust, or Python. * Are excited about DevOps/Infrastructure challenges like GPU utilization, auto-scaling, and latency-aware routing. * Have experience with or a strong interest in vector search systems (Faiss, HNSW) and ML serving runtimes like vLLM. * Prefer a hybrid work model based in Palo Alto.

Job Description

### About the Role

We’re looking for a Senior Engineer to help build the next-generation inference platform that supports embedding models used for semantic search, retrieval, and AI-native experiences in MongoDB Atlas.

You’ll join the broader Search and AI Platform organization and collaborate with ML researchers and engineers from our Voyage.ai acquisition. Together, we’re building infrastructure for real-time, low-latency, and high-scale inference — fully integrated with Atlas and designed for developer-first experiences.

As a Senior Engineer, you'll focus on building core systems and services that power model inference at scale. You'll own key components of the infrastructure, work across teams to ensure tight integration with Atlas, and contribute to a platform designed for reliability, performance, and ease of use.

We're looking to speak with candidates in Palo Alto for our hybrid working model.

### What You’ll Do







### Who You Are








### Nice to Have




### Why Join Us





### About MongoDB

MongoDB is built for change, empowering our customers and our people to innovate at the speed of the market. We have redefined the database for the AI era, enabling innovators to create, transform, and disrupt industries with software. MongoDB’s unified database platform—the most widely available, globally distributed database on the market—helps organizations modernize legacy workloads, embrace innovation, and unleash AI. Our cloud-native platform, MongoDB Atlas, is the only globally distributed, multi-cloud database and is available across AWS, Google Cloud, and Microsoft Azure.

With offices worldwide and nearly 60,000 customers—including 75% of the Fortune 100 and AI-native startups—relying on MongoDB for their most important applications, we’re powering the next era of software.

Our compass at MongoDB is our [Leadership Commitment,](https://www.mongodb.com/company) guiding how and why we make decisions, show up for each other, and win. It’s what makes us MongoDB.

To drive the personal growth and business impact of our employees, we’re committed to developing a supportive and enriching culture for everyone. [From employee affinity groups, to fertility assistance and a generous parental leave policy](https://www.mongodb.com/company/blog/culture/employee-benefits-that-make-a-difference-at-mongodb), we value our employees’ wellbeing and want to support them along every step of their professional and personal journeys.[ Learn more about what it’s like to work at MongoDB](https://www.mongodb.com/blog/channel/culture), and help us make an impact on the world!

MongoDB is committed to providing any necessary accommodations for individuals with disabilities within our application and interview process. To request an accommodation due to a disability, please inform your recruiter.

MongoDB, Inc. provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type and makes all hiring decisions without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.

Req ID: 4263317053

MongoDB’s base salary range for this role is posted below. Compensation at the time of offer is unique to each candidate and based on a variety of factors such as skill set, experience, qualifications, and work location. Salary is one part of MongoDB’s total compensation and benefits package. Other benefits for eligible employees may include: equity, participation in the employee stock purchase program, flexible paid time off, 20 weeks fully-paid gender-neutral parental leave, fertility and adoption assistance, 401(k) plan, mental health counseling, access to transgender-inclusive health insurance coverage, and health benefits offerings. Please note, the base salary range listed below and the benefits in this paragraph are only applicable to U.S.-based candidates.

MongoDB’s base salary range for this role in the U.S. is:
$126,000—$248,000 USD

View this job on nocollar jobs